2023-03-19 14:52:58,298 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-19 14:52:58,534 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24 2023-03-19 14:52:58,548 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-19 14:52:58,549 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/cluster_f5186ab3-a777-2045-9287-c86a253161ea, deleteOnExit=true 2023-03-19 14:52:58,549 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-19 14:52:58,550 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/test.cache.data in system properties and HBase conf 2023-03-19 14:52:58,551 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/hadoop.tmp.dir in system properties and HBase conf 2023-03-19 14:52:58,551 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/hadoop.log.dir in system properties and HBase conf 2023-03-19 14:52:58,552 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-19 14:52:58,552 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-19 14:52:58,553 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-19 14:52:58,658 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-19 14:52:59,036 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-19 14:52:59,040 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-19 14:52:59,040 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-19 14:52:59,041 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-19 14:52:59,041 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-19 14:52:59,041 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-19 14:52:59,042 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-19 14:52:59,042 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-19 14:52:59,042 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-19 14:52:59,043 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-19 14:52:59,043 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/nfs.dump.dir in system properties and HBase conf 2023-03-19 14:52:59,043 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/java.io.tmpdir in system properties and HBase conf 2023-03-19 14:52:59,044 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-19 14:52:59,044 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-19 14:52:59,045 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-19 14:52:59,563 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-19 14:52:59,567 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-19 14:52:59,809 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-19 14:52:59,989 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-19 14:53:00,009 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-19 14:53:00,055 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-19 14:53:00,099 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/java.io.tmpdir/Jetty_localhost_localdomain_43021_hdfs____g62fe2/webapp 2023-03-19 14:53:00,255 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:43021 2023-03-19 14:53:00,271 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-19 14:53:00,271 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-19 14:53:00,943 WARN [Listener at localhost.localdomain/38377] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-19 14:53:01,050 WARN [Listener at localhost.localdomain/38377] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-19 14:53:01,082 WARN [Listener at localhost.localdomain/38377] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-19 14:53:01,092 INFO [Listener at localhost.localdomain/38377] log.Slf4jLog(67): jetty-6.1.26 2023-03-19 14:53:01,109 INFO [Listener at localhost.localdomain/38377] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/java.io.tmpdir/Jetty_localhost_33901_datanode____.s4kxhb/webapp 2023-03-19 14:53:01,271 INFO [Listener at localhost.localdomain/38377] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33901 2023-03-19 14:53:01,771 WARN [Listener at localhost.localdomain/46521] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-19 14:53:02,308 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc34ab5ea36303103: Processing first storage report for DS-0304713a-e268-4e65-97c3-a1e77e358520 from datanode 9c893e8f-308d-4932-a68b-74c956cc7de0 2023-03-19 14:53:02,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc34ab5ea36303103: from storage DS-0304713a-e268-4e65-97c3-a1e77e358520 node DatanodeRegistration(127.0.0.1:41239, datanodeUuid=9c893e8f-308d-4932-a68b-74c956cc7de0, infoPort=40461, infoSecurePort=0, ipcPort=46521, storageInfo=lv=-57;cid=testClusterID;nsid=1039465274;c=1679237579633), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-03-19 14:53:02,310 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc34ab5ea36303103: Processing first storage report for DS-065ab597-eb1b-48a1-9a1e-d217f49ddae8 from datanode 9c893e8f-308d-4932-a68b-74c956cc7de0 2023-03-19 14:53:02,310 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc34ab5ea36303103: from storage DS-065ab597-eb1b-48a1-9a1e-d217f49ddae8 node DatanodeRegistration(127.0.0.1:41239, datanodeUuid=9c893e8f-308d-4932-a68b-74c956cc7de0, infoPort=40461, infoSecurePort=0, ipcPort=46521, storageInfo=lv=-57;cid=testClusterID;nsid=1039465274;c=1679237579633), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-03-19 14:53:02,381 DEBUG [Listener at localhost.localdomain/46521] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24 2023-03-19 14:53:02,444 INFO [Listener at localhost.localdomain/46521] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/cluster_f5186ab3-a777-2045-9287-c86a253161ea/zookeeper_0, clientPort=56323, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/cluster_f5186ab3-a777-2045-9287-c86a253161ea/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/cluster_f5186ab3-a777-2045-9287-c86a253161ea/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-19 14:53:02,460 INFO [Listener at localhost.localdomain/46521] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56323 2023-03-19 14:53:02,468 INFO [Listener at localhost.localdomain/46521] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-19 14:53:02,471 INFO [Listener at localhost.localdomain/46521] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-19 14:53:03,183 INFO [Listener at localhost.localdomain/46521] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f with version=8 2023-03-19 14:53:03,183 INFO [Listener at localhost.localdomain/46521] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/hbase-staging 2023-03-19 14:53:03,468 INFO [Listener at localhost.localdomain/46521] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-19 14:53:03,933 INFO [Listener at localhost.localdomain/46521] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-03-19 14:53:03,960 INFO [Listener at localhost.localdomain/46521] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-19 14:53:03,960 INFO [Listener at localhost.localdomain/46521] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-19 14:53:03,961 INFO [Listener at localhost.localdomain/46521] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-19 14:53:03,961 INFO [Listener at localhost.localdomain/46521] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-19 14:53:03,961 INFO [Listener at localhost.localdomain/46521] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-19 14:53:04,089 INFO [Listener at localhost.localdomain/46521] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-19 14:53:04,159 DEBUG [Listener at localhost.localdomain/46521] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-19 14:53:04,243 INFO [Listener at localhost.localdomain/46521] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35187 2023-03-19 14:53:04,252 INFO [Listener at localhost.localdomain/46521] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-19 14:53:04,254 INFO [Listener at localhost.localdomain/46521] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-19 14:53:04,271 INFO [Listener at localhost.localdomain/46521] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35187 connecting to ZooKeeper ensemble=127.0.0.1:56323 2023-03-19 14:53:04,305 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:351870x0, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-19 14:53:04,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35187-0x1002a1226880000 connected 2023-03-19 14:53:04,347 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-19 14:53:04,347 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-19 14:53:04,352 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-19 14:53:04,361 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35187 2023-03-19 14:53:04,361 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35187 2023-03-19 14:53:04,362 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35187 2023-03-19 14:53:04,362 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35187 2023-03-19 14:53:04,363 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35187 2023-03-19 14:53:04,368 INFO [Listener at localhost.localdomain/46521] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f, hbase.cluster.distributed=false 2023-03-19 14:53:04,458 INFO [Listener at localhost.localdomain/46521] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-03-19 14:53:04,458 INFO [Listener at localhost.localdomain/46521] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-19 14:53:04,458 INFO [Listener at localhost.localdomain/46521] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-19 14:53:04,459 INFO [Listener at localhost.localdomain/46521] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-19 14:53:04,459 INFO [Listener at localhost.localdomain/46521] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-19 14:53:04,459 INFO [Listener at localhost.localdomain/46521] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-19 14:53:04,463 INFO [Listener at localhost.localdomain/46521] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-19 14:53:04,465 INFO [Listener at localhost.localdomain/46521] ipc.NettyRpcServer(120): Bind to /148.251.75.209:33191 2023-03-19 14:53:04,467 INFO [Listener at localhost.localdomain/46521] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-19 14:53:04,472 DEBUG [Listener at localhost.localdomain/46521] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-19 14:53:04,473 INFO [Listener at localhost.localdomain/46521] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-19 14:53:04,477 INFO [Listener at localhost.localdomain/46521] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-19 14:53:04,481 INFO [Listener at localhost.localdomain/46521] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33191 connecting to ZooKeeper ensemble=127.0.0.1:56323 2023-03-19 14:53:04,516 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:331910x0, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-19 14:53:04,519 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ZKUtil(164): regionserver:331910x0, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-19 14:53:04,546 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ZKUtil(164): regionserver:331910x0, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-19 14:53:04,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33191-0x1002a1226880001 connected 2023-03-19 14:53:04,548 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-19 14:53:04,582 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33191 2023-03-19 14:53:04,596 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33191 2023-03-19 14:53:04,614 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33191 2023-03-19 14:53:04,617 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33191 2023-03-19 14:53:04,618 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33191 2023-03-19 14:53:04,620 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,35187,1679237583319 2023-03-19 14:53:04,630 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-19 14:53:04,631 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,35187,1679237583319 2023-03-19 14:53:04,653 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-19 14:53:04,653 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-19 14:53:04,654 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-19 14:53:04,654 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-19 14:53:04,656 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,35187,1679237583319 from backup master directory 2023-03-19 14:53:04,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-19 14:53:04,662 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,35187,1679237583319 2023-03-19 14:53:04,663 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-19 14:53:04,663 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-19 14:53:04,664 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,35187,1679237583319 2023-03-19 14:53:04,666 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-19 14:53:04,668 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-19 14:53:04,765 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/hbase.id with ID: 4fe78549-1434-4310-a6d9-b55df8a2e7bb 2023-03-19 14:53:04,823 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-19 14:53:04,845 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-19 14:53:04,885 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x33f34810 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:53:04,923 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@177ca70b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:53:04,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-19 14:53:04,949 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-19 14:53:04,968 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-19 14:53:04,968 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-19 14:53:04,971 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-19 14:53:04,975 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-19 14:53:04,976 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-19 14:53:05,006 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/data/master/store-tmp 2023-03-19 14:53:05,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:05,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-19 14:53:05,035 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-19 14:53:05,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-19 14:53:05,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-19 14:53:05,035 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-19 14:53:05,035 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-19 14:53:05,036 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-19 14:53:05,037 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/WALs/jenkins-hbase20.apache.org,35187,1679237583319 2023-03-19 14:53:05,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35187%2C1679237583319, suffix=, logDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/WALs/jenkins-hbase20.apache.org,35187,1679237583319, archiveDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/oldWALs, maxLogs=10 2023-03-19 14:53:05,110 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41239,DS-0304713a-e268-4e65-97c3-a1e77e358520,DISK] 2023-03-19 14:53:05,118 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-19 14:53:05,181 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/WALs/jenkins-hbase20.apache.org,35187,1679237583319/jenkins-hbase20.apache.org%2C35187%2C1679237583319.1679237585067 2023-03-19 14:53:05,186 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41239,DS-0304713a-e268-4e65-97c3-a1e77e358520,DISK]] 2023-03-19 14:53:05,186 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:53:05,187 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:05,191 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-19 14:53:05,192 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-19 14:53:05,255 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-19 14:53:05,263 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-19 14:53:05,308 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-19 14:53:05,322 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:05,328 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-19 14:53:05,330 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-19 14:53:05,349 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-19 14:53:05,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:53:05,354 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72547063, jitterRate=0.08103547990322113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:53:05,354 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-19 14:53:05,355 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-19 14:53:05,373 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-19 14:53:05,373 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-19 14:53:05,375 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-19 14:53:05,377 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-19 14:53:05,404 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 26 msec 2023-03-19 14:53:05,404 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-19 14:53:05,426 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-19 14:53:05,432 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-19 14:53:05,459 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-19 14:53:05,462 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-19 14:53:05,463 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-19 14:53:05,467 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-19 14:53:05,471 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-19 14:53:05,473 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-19 14:53:05,475 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-19 14:53:05,475 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-19 14:53:05,490 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-19 14:53:05,495 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-19 14:53:05,495 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-19 14:53:05,496 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-19 14:53:05,496 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,35187,1679237583319, sessionid=0x1002a1226880000, setting cluster-up flag (Was=false) 2023-03-19 14:53:05,514 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-19 14:53:05,518 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-19 14:53:05,519 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,35187,1679237583319 2023-03-19 14:53:05,537 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-19 14:53:05,563 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-19 14:53:05,564 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,35187,1679237583319 2023-03-19 14:53:05,567 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/.tmp 2023-03-19 14:53:05,622 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(952): ClusterId : 4fe78549-1434-4310-a6d9-b55df8a2e7bb 2023-03-19 14:53:05,627 DEBUG [RS:0;jenkins-hbase20:33191] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-19 14:53:05,633 DEBUG [RS:0;jenkins-hbase20:33191] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-19 14:53:05,633 DEBUG [RS:0;jenkins-hbase20:33191] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-19 14:53:05,639 DEBUG [RS:0;jenkins-hbase20:33191] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-19 14:53:05,640 DEBUG [RS:0;jenkins-hbase20:33191] zookeeper.ReadOnlyZKClient(139): Connect 0x34d84d19 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:53:05,649 DEBUG [RS:0;jenkins-hbase20:33191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a1fa5f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:53:05,650 DEBUG [RS:0;jenkins-hbase20:33191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e202669, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-03-19 14:53:05,679 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:33191 2023-03-19 14:53:05,684 INFO [RS:0;jenkins-hbase20:33191] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-19 14:53:05,684 INFO [RS:0;jenkins-hbase20:33191] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-19 14:53:05,684 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1023): About to register with Master. 2023-03-19 14:53:05,687 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,35187,1679237583319 with isa=jenkins-hbase20.apache.org/148.251.75.209:33191, startcode=1679237584457 2023-03-19 14:53:05,696 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-19 14:53:05,703 DEBUG [RS:0;jenkins-hbase20:33191] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-19 14:53:05,705 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-19 14:53:05,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-19 14:53:05,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-19 14:53:05,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-19 14:53:05,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-03-19 14:53:05,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-03-19 14:53:05,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,709 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1679237615708 2023-03-19 14:53:05,711 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-19 14:53:05,714 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-19 14:53:05,714 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-19 14:53:05,719 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-19 14:53:05,724 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-19 14:53:05,730 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-19 14:53:05,731 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-19 14:53:05,731 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-19 14:53:05,732 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-19 14:53:05,733 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:05,739 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-19 14:53:05,741 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-19 14:53:05,741 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-19 14:53:05,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-19 14:53:05,748 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-19 14:53:05,752 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1679237585751,5,FailOnTimeoutGroup] 2023-03-19 14:53:05,752 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1679237585752,5,FailOnTimeoutGroup] 2023-03-19 14:53:05,752 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:05,752 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-19 14:53:05,754 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:05,754 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:05,755 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-19 14:53:05,756 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-19 14:53:05,756 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f 2023-03-19 14:53:05,768 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36149, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-19 14:53:05,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:05,794 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f 2023-03-19 14:53:05,794 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:38377 2023-03-19 14:53:05,794 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-19 14:53:05,800 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-19 14:53:05,800 DEBUG [RS:0;jenkins-hbase20:33191] zookeeper.ZKUtil(162): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:05,800 WARN [RS:0;jenkins-hbase20:33191] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-19 14:53:05,801 INFO [RS:0;jenkins-hbase20:33191] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-19 14:53:05,802 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/WALs/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:05,802 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,33191,1679237584457] 2023-03-19 14:53:05,812 DEBUG [RS:0;jenkins-hbase20:33191] zookeeper.ZKUtil(162): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:05,825 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-19 14:53:05,835 INFO [RS:0;jenkins-hbase20:33191] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-19 14:53:05,855 INFO [RS:0;jenkins-hbase20:33191] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-19 14:53:05,858 INFO [RS:0;jenkins-hbase20:33191] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:53:05,858 INFO [RS:0;jenkins-hbase20:33191] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:05,860 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-19 14:53:05,868 INFO [RS:0;jenkins-hbase20:33191] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-19 14:53:05,869 DEBUG [RS:0;jenkins-hbase20:33191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,869 DEBUG [RS:0;jenkins-hbase20:33191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,870 DEBUG [RS:0;jenkins-hbase20:33191] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,870 DEBUG [RS:0;jenkins-hbase20:33191] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,870 DEBUG [RS:0;jenkins-hbase20:33191] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,870 DEBUG [RS:0;jenkins-hbase20:33191] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-03-19 14:53:05,871 DEBUG [RS:0;jenkins-hbase20:33191] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,871 DEBUG [RS:0;jenkins-hbase20:33191] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,871 DEBUG [RS:0;jenkins-hbase20:33191] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,871 DEBUG [RS:0;jenkins-hbase20:33191] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-19 14:53:05,881 INFO [RS:0;jenkins-hbase20:33191] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:05,881 INFO [RS:0;jenkins-hbase20:33191] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:05,881 INFO [RS:0;jenkins-hbase20:33191] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:05,898 INFO [RS:0;jenkins-hbase20:33191] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-19 14:53:05,901 INFO [RS:0;jenkins-hbase20:33191] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,33191,1679237584457-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:05,919 INFO [RS:0;jenkins-hbase20:33191] regionserver.Replication(203): jenkins-hbase20.apache.org,33191,1679237584457 started 2023-03-19 14:53:05,919 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,33191,1679237584457, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:33191, sessionid=0x1002a1226880001 2023-03-19 14:53:05,920 DEBUG [RS:0;jenkins-hbase20:33191] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-19 14:53:05,920 DEBUG [RS:0;jenkins-hbase20:33191] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:05,920 DEBUG [RS:0;jenkins-hbase20:33191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33191,1679237584457' 2023-03-19 14:53:05,920 DEBUG [RS:0;jenkins-hbase20:33191] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:05,921 DEBUG [RS:0;jenkins-hbase20:33191] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:05,921 DEBUG [RS:0;jenkins-hbase20:33191] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-19 14:53:05,921 DEBUG [RS:0;jenkins-hbase20:33191] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-19 14:53:05,921 DEBUG [RS:0;jenkins-hbase20:33191] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:05,921 DEBUG [RS:0;jenkins-hbase20:33191] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,33191,1679237584457' 2023-03-19 14:53:05,921 DEBUG [RS:0;jenkins-hbase20:33191] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-19 14:53:05,922 DEBUG [RS:0;jenkins-hbase20:33191] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-19 14:53:05,922 DEBUG [RS:0;jenkins-hbase20:33191] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-19 14:53:05,923 INFO [RS:0;jenkins-hbase20:33191] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-19 14:53:05,923 INFO [RS:0;jenkins-hbase20:33191] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-19 14:53:06,034 INFO [RS:0;jenkins-hbase20:33191] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33191%2C1679237584457, suffix=, logDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/WALs/jenkins-hbase20.apache.org,33191,1679237584457, archiveDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/oldWALs, maxLogs=32 2023-03-19 14:53:06,057 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41239,DS-0304713a-e268-4e65-97c3-a1e77e358520,DISK] 2023-03-19 14:53:06,060 INFO [RS:0;jenkins-hbase20:33191] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/WALs/jenkins-hbase20.apache.org,33191,1679237584457/jenkins-hbase20.apache.org%2C33191%2C1679237584457.1679237586037 2023-03-19 14:53:06,061 DEBUG [RS:0;jenkins-hbase20:33191] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41239,DS-0304713a-e268-4e65-97c3-a1e77e358520,DISK]] 2023-03-19 14:53:06,173 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:06,176 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-19 14:53:06,178 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/info 2023-03-19 14:53:06,179 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-19 14:53:06,181 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:06,181 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-19 14:53:06,184 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/rep_barrier 2023-03-19 14:53:06,185 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-19 14:53:06,186 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:06,186 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-19 14:53:06,188 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/table 2023-03-19 14:53:06,189 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-19 14:53:06,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:06,192 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740 2023-03-19 14:53:06,193 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740 2023-03-19 14:53:06,196 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-19 14:53:06,198 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-19 14:53:06,201 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:53:06,202 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71559801, jitterRate=0.0663241297006607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-19 14:53:06,202 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-19 14:53:06,202 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-19 14:53:06,202 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-19 14:53:06,203 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-19 14:53:06,203 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-19 14:53:06,203 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-19 14:53:06,204 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-19 14:53:06,204 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-19 14:53:06,209 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-19 14:53:06,209 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-19 14:53:06,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-19 14:53:06,231 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-19 14:53:06,233 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-19 14:53:06,386 DEBUG [jenkins-hbase20:35187] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-19 14:53:06,389 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,33191,1679237584457, state=OPENING 2023-03-19 14:53:06,395 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-19 14:53:06,396 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-19 14:53:06,397 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-19 14:53:06,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:06,581 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:06,584 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-19 14:53:06,587 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60080, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-19 14:53:06,600 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-19 14:53:06,600 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-19 14:53:06,604 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C33191%2C1679237584457.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/WALs/jenkins-hbase20.apache.org,33191,1679237584457, archiveDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/oldWALs, maxLogs=32 2023-03-19 14:53:06,622 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41239,DS-0304713a-e268-4e65-97c3-a1e77e358520,DISK] 2023-03-19 14:53:06,640 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/WALs/jenkins-hbase20.apache.org,33191,1679237584457/jenkins-hbase20.apache.org%2C33191%2C1679237584457.meta.1679237586606.meta 2023-03-19 14:53:06,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41239,DS-0304713a-e268-4e65-97c3-a1e77e358520,DISK]] 2023-03-19 14:53:06,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:53:06,642 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-19 14:53:06,658 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-19 14:53:06,663 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-19 14:53:06,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-19 14:53:06,668 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:06,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-19 14:53:06,669 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-19 14:53:06,673 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-19 14:53:06,674 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/info 2023-03-19 14:53:06,675 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/info 2023-03-19 14:53:06,675 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-19 14:53:06,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:06,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-19 14:53:06,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/rep_barrier 2023-03-19 14:53:06,678 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/rep_barrier 2023-03-19 14:53:06,679 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-19 14:53:06,679 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:06,680 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-19 14:53:06,681 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/table 2023-03-19 14:53:06,681 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/table 2023-03-19 14:53:06,682 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-19 14:53:06,683 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:06,685 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740 2023-03-19 14:53:06,688 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740 2023-03-19 14:53:06,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-19 14:53:06,695 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-19 14:53:06,698 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64302948, jitterRate=-0.04181140661239624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-19 14:53:06,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-19 14:53:06,710 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1679237586574 2023-03-19 14:53:06,734 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-19 14:53:06,735 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-19 14:53:06,735 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,33191,1679237584457, state=OPEN 2023-03-19 14:53:06,738 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-19 14:53:06,738 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-19 14:53:06,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-19 14:53:06,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,33191,1679237584457 in 339 msec 2023-03-19 14:53:06,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-19 14:53:06,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 527 msec 2023-03-19 14:53:06,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1360 sec 2023-03-19 14:53:06,757 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1679237586757, completionTime=-1 2023-03-19 14:53:06,757 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-19 14:53:06,758 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-03-19 14:53:06,831 DEBUG [hconnection-0x7ef00bf8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:53:06,835 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:53:06,852 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=1 2023-03-19 14:53:06,852 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1679237646852 2023-03-19 14:53:06,852 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1679237706852 2023-03-19 14:53:06,852 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 94 msec 2023-03-19 14:53:06,882 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35187,1679237583319-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:06,883 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35187,1679237583319-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:06,883 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35187,1679237583319-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:06,885 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:35187, period=300000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:06,885 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-19 14:53:06,891 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-19 14:53:06,901 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-19 14:53:06,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-19 14:53:06,913 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-19 14:53:06,915 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:53:06,919 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:53:06,941 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5 2023-03-19 14:53:06,944 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5 empty. 2023-03-19 14:53:06,944 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5 2023-03-19 14:53:06,945 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-19 14:53:07,368 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-19 14:53:07,370 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => adbe920c69673baa5c427cdf0bd93cc5, NAME => 'hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:53:07,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:07,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing adbe920c69673baa5c427cdf0bd93cc5, disabling compactions & flushes 2023-03-19 14:53:07,783 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:53:07,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:53:07,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. after waiting 0 ms 2023-03-19 14:53:07,783 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:53:07,784 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:53:07,784 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for adbe920c69673baa5c427cdf0bd93cc5: 2023-03-19 14:53:07,789 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:53:07,802 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679237587792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237587792"}]},"ts":"1679237587792"} 2023-03-19 14:53:07,825 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-19 14:53:07,828 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:53:07,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237587828"}]},"ts":"1679237587828"} 2023-03-19 14:53:07,836 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-19 14:53:07,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=adbe920c69673baa5c427cdf0bd93cc5, ASSIGN}] 2023-03-19 14:53:07,847 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=adbe920c69673baa5c427cdf0bd93cc5, ASSIGN 2023-03-19 14:53:07,848 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=adbe920c69673baa5c427cdf0bd93cc5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:53:08,000 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=adbe920c69673baa5c427cdf0bd93cc5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:08,000 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679237587999"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237587999"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237587999"}]},"ts":"1679237587999"} 2023-03-19 14:53:08,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure adbe920c69673baa5c427cdf0bd93cc5, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:08,165 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:53:08,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => adbe920c69673baa5c427cdf0bd93cc5, NAME => 'hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:53:08,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace adbe920c69673baa5c427cdf0bd93cc5 2023-03-19 14:53:08,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:08,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for adbe920c69673baa5c427cdf0bd93cc5 2023-03-19 14:53:08,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for adbe920c69673baa5c427cdf0bd93cc5 2023-03-19 14:53:08,169 INFO [StoreOpener-adbe920c69673baa5c427cdf0bd93cc5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region adbe920c69673baa5c427cdf0bd93cc5 2023-03-19 14:53:08,171 DEBUG [StoreOpener-adbe920c69673baa5c427cdf0bd93cc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5/info 2023-03-19 14:53:08,171 DEBUG [StoreOpener-adbe920c69673baa5c427cdf0bd93cc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5/info 2023-03-19 14:53:08,171 INFO [StoreOpener-adbe920c69673baa5c427cdf0bd93cc5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adbe920c69673baa5c427cdf0bd93cc5 columnFamilyName info 2023-03-19 14:53:08,172 INFO [StoreOpener-adbe920c69673baa5c427cdf0bd93cc5-1] regionserver.HStore(310): Store=adbe920c69673baa5c427cdf0bd93cc5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:08,174 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5 2023-03-19 14:53:08,175 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5 2023-03-19 14:53:08,179 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for adbe920c69673baa5c427cdf0bd93cc5 2023-03-19 14:53:08,183 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:53:08,184 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened adbe920c69673baa5c427cdf0bd93cc5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75460654, jitterRate=0.12445136904716492}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:53:08,184 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for adbe920c69673baa5c427cdf0bd93cc5: 2023-03-19 14:53:08,186 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5., pid=6, masterSystemTime=1679237588158 2023-03-19 14:53:08,191 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:53:08,191 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:53:08,192 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=adbe920c69673baa5c427cdf0bd93cc5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:08,193 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1679237588192"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237588192"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237588192"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237588192"}]},"ts":"1679237588192"} 2023-03-19 14:53:08,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-19 14:53:08,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure adbe920c69673baa5c427cdf0bd93cc5, server=jenkins-hbase20.apache.org,33191,1679237584457 in 193 msec 2023-03-19 14:53:08,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-19 14:53:08,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=adbe920c69673baa5c427cdf0bd93cc5, ASSIGN in 356 msec 2023-03-19 14:53:08,206 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:53:08,206 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237588206"}]},"ts":"1679237588206"} 2023-03-19 14:53:08,209 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-19 14:53:08,213 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:53:08,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3090 sec 2023-03-19 14:53:08,226 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-19 14:53:08,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-19 14:53:08,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-19 14:53:08,276 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-19 14:53:08,296 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-19 14:53:08,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-03-19 14:53:08,310 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-19 14:53:08,323 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-19 14:53:08,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-03-19 14:53:08,338 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-19 14:53:08,340 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-19 14:53:08,341 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.677sec 2023-03-19 14:53:08,343 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-19 14:53:08,344 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-19 14:53:08,344 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-19 14:53:08,345 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35187,1679237583319-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-19 14:53:08,347 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35187,1679237583319-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-19 14:53:08,356 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-19 14:53:08,430 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ReadOnlyZKClient(139): Connect 0x6acc7512 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:53:08,435 DEBUG [Listener at localhost.localdomain/46521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@418632d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:53:08,451 DEBUG [hconnection-0x41943749-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:53:08,462 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60098, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:53:08,475 INFO [Listener at localhost.localdomain/46521] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,35187,1679237583319 2023-03-19 14:53:08,476 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ReadOnlyZKClient(139): Connect 0x1cf395ba to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:53:08,481 DEBUG [Listener at localhost.localdomain/46521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57d271f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:53:08,481 INFO [Listener at localhost.localdomain/46521] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-19 14:53:08,506 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=209, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=346, ProcessCount=168, AvailableMemoryMB=4999 2023-03-19 14:53:08,520 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:53:08,524 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41586, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:53:08,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-19 14:53:08,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:08,542 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:53:08,545 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:53:08,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-19 14:53:08,548 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:08,550 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21 empty. 2023-03-19 14:53:08,551 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:08,552 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-19 14:53:08,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-19 14:53:08,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-19 14:53:08,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-19 14:53:08,972 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-19 14:53:08,974 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 62083c107c616f5c217d55e9a72a6e21, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:53:08,989 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:08,989 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 62083c107c616f5c217d55e9a72a6e21, disabling compactions & flushes 2023-03-19 14:53:08,990 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:08,990 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:08,990 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. after waiting 0 ms 2023-03-19 14:53:08,990 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:08,990 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:08,990 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:08,995 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:53:08,997 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679237588997"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237588997"}]},"ts":"1679237588997"} 2023-03-19 14:53:09,000 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-19 14:53:09,002 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:53:09,002 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237589002"}]},"ts":"1679237589002"} 2023-03-19 14:53:09,005 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-19 14:53:09,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=62083c107c616f5c217d55e9a72a6e21, ASSIGN}] 2023-03-19 14:53:09,011 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=62083c107c616f5c217d55e9a72a6e21, ASSIGN 2023-03-19 14:53:09,013 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=62083c107c616f5c217d55e9a72a6e21, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:53:09,165 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=62083c107c616f5c217d55e9a72a6e21, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:09,165 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679237589165"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237589165"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237589165"}]},"ts":"1679237589165"} 2023-03-19 14:53:09,169 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 62083c107c616f5c217d55e9a72a6e21, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:09,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-19 14:53:09,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62083c107c616f5c217d55e9a72a6e21, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:53:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:09,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:09,332 INFO [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:09,335 DEBUG [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1 2023-03-19 14:53:09,335 DEBUG [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1 2023-03-19 14:53:09,339 INFO [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62083c107c616f5c217d55e9a72a6e21 columnFamilyName family1 2023-03-19 14:53:09,343 INFO [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] regionserver.HStore(310): Store=62083c107c616f5c217d55e9a72a6e21/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:09,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:09,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:09,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:09,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:53:09,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 62083c107c616f5c217d55e9a72a6e21; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69007906, jitterRate=0.02829793095588684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:53:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:09,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21., pid=11, masterSystemTime=1679237589322 2023-03-19 14:53:09,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:09,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:09,362 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=62083c107c616f5c217d55e9a72a6e21, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:09,362 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679237589362"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237589362"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237589362"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237589362"}]},"ts":"1679237589362"} 2023-03-19 14:53:09,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-19 14:53:09,370 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 62083c107c616f5c217d55e9a72a6e21, server=jenkins-hbase20.apache.org,33191,1679237584457 in 198 msec 2023-03-19 14:53:09,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-19 14:53:09,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=62083c107c616f5c217d55e9a72a6e21, ASSIGN in 362 msec 2023-03-19 14:53:09,375 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:53:09,375 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237589375"}]},"ts":"1679237589375"} 2023-03-19 14:53:09,378 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-19 14:53:09,381 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:53:09,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 843 msec 2023-03-19 14:53:09,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-19 14:53:09,672 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-19 14:53:09,693 DEBUG [hconnection-0x3da22862-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:53:09,696 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60108, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:53:09,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:09,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:09,854 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:09,855 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:09,855 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-19 14:53:09,855 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-19 14:53:09,856 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:09,856 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:09,857 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:09,857 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:09,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:09,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:09,858 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:09,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:09,858 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:09,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:09,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:09,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:09,859 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:09,860 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:09,861 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-19 14:53:09,861 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:09,861 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-19 14:53:09,862 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:09,862 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:09,862 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:09,863 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. started... 2023-03-19 14:53:09,864 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 62083c107c616f5c217d55e9a72a6e21 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-19 14:53:10,404 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113033fc74d49e47440b803e063b08ec0dc0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113033fc74d49e47440b803e063b08ec0dc0 2023-03-19 14:53:10,821 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/981939d5d3634acb9756eecfb53fab75 2023-03-19 14:53:10,832 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/981939d5d3634acb9756eecfb53fab75 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/981939d5d3634acb9756eecfb53fab75 2023-03-19 14:53:10,843 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/981939d5d3634acb9756eecfb53fab75, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-19 14:53:10,846 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 62083c107c616f5c217d55e9a72a6e21 in 982ms, sequenceid=5, compaction requested=false 2023-03-19 14:53:10,848 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:10,851 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:10,851 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:10,851 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:10,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:10,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-19 14:53:10,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-19 14:53:10,854 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,854 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:10,855 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,855 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:10,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:10,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:10,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-19 14:53:10,857 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-19 14:53:10,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64d85fa2[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:10,857 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,858 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,858 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-19 14:53:10,859 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,859 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-19 14:53:10,859 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:10,859 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:10,861 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,861 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-19 14:53:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:10,861 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:10,861 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-19 14:53:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:10,864 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-19 14:53:10,865 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:10,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-19 14:53:10,865 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:10,865 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,865 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:10,870 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,870 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,871 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:10,871 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:10,873 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,880 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,880 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:10,880 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:10,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:10,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:10,880 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:10,880 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:10,880 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,881 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:10,881 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,881 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,881 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:10,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:10,883 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:10,883 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:10,983 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:10,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:11,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:11,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:11,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,004 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:11,004 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:11,004 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-19 14:53:11,004 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-19 14:53:11,005 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,005 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,006 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:11,006 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:11,007 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,007 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,007 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,008 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-19 14:53:11,008 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,008 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-19 14:53:11,008 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:11,009 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-19 14:53:11,009 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:11,009 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:11,009 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:11,009 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. started... 2023-03-19 14:53:11,009 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 62083c107c616f5c217d55e9a72a6e21 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-19 14:53:11,454 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112855e3ae9049864314933358d248338996 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112855e3ae9049864314933358d248338996 2023-03-19 14:53:11,909 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/d5832784e738423382cfa08e9d0185ff 2023-03-19 14:53:11,918 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/d5832784e738423382cfa08e9d0185ff as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/d5832784e738423382cfa08e9d0185ff 2023-03-19 14:53:11,927 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/d5832784e738423382cfa08e9d0185ff, entries=1, sequenceid=9, filesize=5.0 K 2023-03-19 14:53:11,928 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 62083c107c616f5c217d55e9a72a6e21 in 919ms, sequenceid=9, compaction requested=false 2023-03-19 14:53:11,929 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:11,929 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:11,929 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:11,929 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:11,929 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,929 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-19 14:53:11,929 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-19 14:53:11,931 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,931 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:11,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:11,932 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,932 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:11,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:11,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:11,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:11,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-19 14:53:11,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6df4a78[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:11,933 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-19 14:53:11,934 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,934 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,935 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,935 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:11,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,935 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-19 14:53:11,935 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-19 14:53:11,935 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:11,938 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-19 14:53:11,938 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,938 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:11,938 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-19 14:53:11,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:11,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:11,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:11,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-19 14:53:11,941 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-19 14:53:11,941 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:11,941 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:11,941 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,941 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:11,943 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,943 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:11,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:11,943 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,945 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,946 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:11,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:11,947 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:11,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:11,947 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,948 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:11,948 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,948 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:11,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:11,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:11,948 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:11,948 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,948 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,948 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:11,948 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:11,948 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:11,949 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:11,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:11,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-19 14:53:12,049 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:12,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:12,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:12,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:12,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,075 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:12,075 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:12,075 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-19 14:53:12,075 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-19 14:53:12,076 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,076 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,077 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,077 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:12,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:12,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:12,078 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,078 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,083 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-19 14:53:12,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,083 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-19 14:53:12,083 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:12,084 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-19 14:53:12,084 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:12,084 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:12,084 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:12,084 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. started... 2023-03-19 14:53:12,087 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 62083c107c616f5c217d55e9a72a6e21 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:12,192 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:53:12,220 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120111741b52613240bdb84d168ac5496ead to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120111741b52613240bdb84d168ac5496ead 2023-03-19 14:53:12,339 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-19 14:53:12,341 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-19 14:53:12,677 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/676c1007a87f4cf081f6f3a000369857 2023-03-19 14:53:12,687 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/676c1007a87f4cf081f6f3a000369857 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/676c1007a87f4cf081f6f3a000369857 2023-03-19 14:53:12,697 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/676c1007a87f4cf081f6f3a000369857, entries=1, sequenceid=13, filesize=5.0 K 2023-03-19 14:53:12,699 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 62083c107c616f5c217d55e9a72a6e21 in 615ms, sequenceid=13, compaction requested=true 2023-03-19 14:53:12,699 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:12,699 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:12,699 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:12,700 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:12,700 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,700 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-19 14:53:12,700 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-19 14:53:12,702 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,702 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:12,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:12,702 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,702 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:12,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:12,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-19 14:53:12,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52d2cc03[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:12,704 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-19 14:53:12,704 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,705 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,705 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-19 14:53:12,705 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-19 14:53:12,705 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,705 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:12,705 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:12,707 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,707 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-19 14:53:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:12,707 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:12,707 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-19 14:53:12,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:12,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:12,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:12,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:12,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-19 14:53:12,710 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-19 14:53:12,710 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:12,710 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:12,710 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,710 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:12,712 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,712 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:12,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,712 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:12,712 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:12,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,714 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:12,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,720 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:12,720 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:12,721 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:12,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:12,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:12,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:12,721 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,721 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,722 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,722 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,722 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,722 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-19 14:53:12,722 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:12,722 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:12,721 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:12,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:12,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:12,822 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:12,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:12,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:12,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:12,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,838 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:12,838 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:12,838 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-19 14:53:12,838 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-19 14:53:12,839 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,839 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,840 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:12,840 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:12,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:12,841 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:12,841 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:12,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:12,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,841 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,842 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-19 14:53:12,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:12,842 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-19 14:53:12,842 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:12,842 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-19 14:53:12,843 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:12,843 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:12,843 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:12,843 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. started... 2023-03-19 14:53:12,843 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 62083c107c616f5c217d55e9a72a6e21 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:13,268 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051db437975d664907b3e9bca62a327332 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512051db437975d664907b3e9bca62a327332 2023-03-19 14:53:13,464 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-19 14:53:13,464 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-19 14:53:13,684 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/83593cc1751647ec997c2e110b396162 2023-03-19 14:53:13,696 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/83593cc1751647ec997c2e110b396162 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/83593cc1751647ec997c2e110b396162 2023-03-19 14:53:13,708 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/83593cc1751647ec997c2e110b396162, entries=1, sequenceid=17, filesize=5.0 K 2023-03-19 14:53:13,709 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 62083c107c616f5c217d55e9a72a6e21 in 866ms, sequenceid=17, compaction requested=true 2023-03-19 14:53:13,709 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:13,709 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:13,710 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:13,710 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:13,710 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,710 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-19 14:53:13,710 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-19 14:53:13,712 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,712 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:13,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:13,713 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,713 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:13,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:13,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:13,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:13,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-19 14:53:13,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59ea1e7[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:13,715 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-19 14:53:13,715 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,716 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,716 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-19 14:53:13,716 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-19 14:53:13,716 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:13,717 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,717 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:13,718 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,718 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-19 14:53:13,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:13,718 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:13,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:13,719 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-19 14:53:13,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:13,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:13,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:13,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:13,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-19 14:53:13,722 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-19 14:53:13,722 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:13,722 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:13,722 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,722 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:13,729 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,729 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:13,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:13,729 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:13,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,729 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,731 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:13,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,737 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:13,737 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,737 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:13,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-19 14:53:13,737 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:13,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:13,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:13,737 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:13,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:13,738 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,739 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,739 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,739 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,739 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:13,739 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,739 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:13,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:13,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:13,839 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:13,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:13,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:13,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:13,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,852 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:13,852 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:13,852 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-19 14:53:13,852 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-19 14:53:13,853 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,853 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,854 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:13,854 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:13,854 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:13,854 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,856 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-19 14:53:13,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:13,856 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-19 14:53:13,856 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:13,856 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-19 14:53:13,858 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:13,858 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:13,858 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:13,858 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. started... 2023-03-19 14:53:13,858 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 62083c107c616f5c217d55e9a72a6e21 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:14,284 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e039c009b91d4282979882b87b7f91f1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e039c009b91d4282979882b87b7f91f1 2023-03-19 14:53:14,310 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/1ec2273a55a74c65b81570e99ae73b3c 2023-03-19 14:53:14,324 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/1ec2273a55a74c65b81570e99ae73b3c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/1ec2273a55a74c65b81570e99ae73b3c 2023-03-19 14:53:14,339 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/1ec2273a55a74c65b81570e99ae73b3c, entries=1, sequenceid=21, filesize=5.0 K 2023-03-19 14:53:14,341 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 62083c107c616f5c217d55e9a72a6e21 in 483ms, sequenceid=21, compaction requested=true 2023-03-19 14:53:14,341 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:14,341 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:14,341 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:14,342 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:14,342 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,342 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-19 14:53:14,342 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-19 14:53:14,345 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,345 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:14,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:14,345 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,345 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:14,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:14,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:14,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:14,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-19 14:53:14,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@239dcbb9[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:14,347 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-19 14:53:14,347 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,348 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,349 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-19 14:53:14,349 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-19 14:53:14,349 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:14,349 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,349 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:14,350 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-19 14:53:14,350 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:14,350 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-19 14:53:14,350 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:14,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:14,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:14,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:14,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:14,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:14,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-19 14:53:14,355 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-19 14:53:14,355 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:14,355 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:14,355 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,355 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:14,357 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,357 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:14,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,357 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:14,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:14,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:14,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:14,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:14,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,358 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:14,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,360 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:14,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,362 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:14,363 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:14,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:14,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:14,363 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:14,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:14,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:14,363 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,363 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:14,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:14,363 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,364 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,364 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,364 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,364 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,364 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:14,365 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:14,465 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:14,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:14,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:14,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:14,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,480 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:14,480 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:14,481 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-19 14:53:14,481 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-19 14:53:14,481 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,482 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,482 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:14,482 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:14,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:14,489 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,489 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:14,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:14,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,490 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,493 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-19 14:53:14,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,493 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-19 14:53:14,493 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:14,493 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-19 14:53:14,494 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:14,494 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:14,494 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:14,494 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. started... 2023-03-19 14:53:14,494 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 62083c107c616f5c217d55e9a72a6e21 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:14,525 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310b720116a8174571b46dfb64fd5df3f1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310b720116a8174571b46dfb64fd5df3f1 2023-03-19 14:53:14,947 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/f4aaeaf8be68430a92cb774fd7788b44 2023-03-19 14:53:14,957 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/f4aaeaf8be68430a92cb774fd7788b44 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/f4aaeaf8be68430a92cb774fd7788b44 2023-03-19 14:53:14,967 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/f4aaeaf8be68430a92cb774fd7788b44, entries=1, sequenceid=25, filesize=5.0 K 2023-03-19 14:53:14,968 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 62083c107c616f5c217d55e9a72a6e21 in 474ms, sequenceid=25, compaction requested=true 2023-03-19 14:53:14,969 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:14,969 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:14,969 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:14,969 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:14,969 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,969 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-19 14:53:14,969 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-19 14:53:14,970 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:14,971 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:14,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:14,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:14,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-19 14:53:14,973 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,974 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:14,974 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-19 14:53:14,974 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f6dc938[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:14,975 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,975 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-19 14:53:14,975 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-19 14:53:14,975 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:14,975 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,975 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:14,976 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-19 14:53:14,976 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,976 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:14,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,976 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-19 14:53:14,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:14,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:14,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:14,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:14,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:14,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:14,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-19 14:53:14,980 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-19 14:53:14,980 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:14,980 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:14,980 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,980 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:14,987 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,987 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:14,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:14,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:14,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,991 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:14,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:14,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:14,991 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:14,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,993 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:14,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,996 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:14,996 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:14,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:14,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:14,997 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:14,997 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:14,997 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,997 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:14,998 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,998 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,998 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:14,998 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:14,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:14,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:15,007 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:15,008 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:15,108 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:15,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:15,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:15,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:15,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,121 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:15,121 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:15,122 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-19 14:53:15,122 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-19 14:53:15,123 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,123 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,124 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:15,124 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:15,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:15,124 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,125 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:15,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,125 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,126 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-19 14:53:15,126 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,126 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-19 14:53:15,126 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:15,126 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-19 14:53:15,130 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:15,130 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:15,130 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:15,130 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. started... 2023-03-19 14:53:15,130 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 62083c107c616f5c217d55e9a72a6e21 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:15,560 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101ca7c82a89d304c7fb22aa2d307fc6407 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ca7c82a89d304c7fb22aa2d307fc6407 2023-03-19 14:53:15,572 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/8146a423452b4ea6b122b9610715891f 2023-03-19 14:53:15,581 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/8146a423452b4ea6b122b9610715891f as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8146a423452b4ea6b122b9610715891f 2023-03-19 14:53:15,591 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8146a423452b4ea6b122b9610715891f, entries=1, sequenceid=29, filesize=5.0 K 2023-03-19 14:53:15,592 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 62083c107c616f5c217d55e9a72a6e21 in 462ms, sequenceid=29, compaction requested=true 2023-03-19 14:53:15,592 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:15,593 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:15,593 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:15,593 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:15,593 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,593 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-19 14:53:15,594 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-19 14:53:15,595 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,595 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:15,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:15,596 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,596 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:15,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:15,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:15,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:15,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-19 14:53:15,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b9ba402[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:15,597 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-19 14:53:15,598 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,598 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,598 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-19 14:53:15,599 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-19 14:53:15,599 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:15,599 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,599 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:15,599 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-19 14:53:15,599 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,599 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:15,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:15,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:15,600 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-19 14:53:15,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:15,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:15,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:15,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:15,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-19 14:53:15,603 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-19 14:53:15,603 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:15,603 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:15,603 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,603 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:15,604 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,604 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:15,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,604 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:15,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:15,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:15,605 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:15,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,606 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,609 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:15,609 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,609 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:15,609 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:15,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:15,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:15,609 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:15,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:15,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-19 14:53:15,610 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,610 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,610 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,610 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,610 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,610 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:15,611 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:15,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:15,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:15,711 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:15,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:15,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:15,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:15,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,723 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:15,723 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:15,723 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-19 14:53:15,723 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-19 14:53:15,724 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,724 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,725 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,725 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:15,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:15,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:15,725 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:15,725 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:15,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:15,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,726 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,726 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-19 14:53:15,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:15,726 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-19 14:53:15,727 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:15,727 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-19 14:53:15,727 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:15,727 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:15,727 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:15,727 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. started... 2023-03-19 14:53:15,727 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 62083c107c616f5c217d55e9a72a6e21 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:16,152 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030aea186e63344f13b46b68993c7fb050 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030aea186e63344f13b46b68993c7fb050 2023-03-19 14:53:16,171 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/e232f01eb01646d2b311db13c105b573 2023-03-19 14:53:16,181 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/e232f01eb01646d2b311db13c105b573 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/e232f01eb01646d2b311db13c105b573 2023-03-19 14:53:16,189 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/e232f01eb01646d2b311db13c105b573, entries=1, sequenceid=33, filesize=5.0 K 2023-03-19 14:53:16,190 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 62083c107c616f5c217d55e9a72a6e21 in 463ms, sequenceid=33, compaction requested=true 2023-03-19 14:53:16,191 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:16,191 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:16,191 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:16,191 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:16,192 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,192 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-19 14:53:16,192 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-19 14:53:16,193 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,193 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:16,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:16,194 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,194 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:16,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:16,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:16,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:16,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-19 14:53:16,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bfaaf0f[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:16,196 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-19 14:53:16,196 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,196 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,197 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-19 14:53:16,197 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-19 14:53:16,197 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:16,197 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,197 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:16,198 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-19 14:53:16,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,198 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:16,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:16,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:16,198 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-19 14:53:16,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:16,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:16,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:16,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:16,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-19 14:53:16,202 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-19 14:53:16,202 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:16,202 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:16,202 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,202 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:16,204 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:16,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:16,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:16,204 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:16,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,206 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:16,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,208 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,209 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,209 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,209 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,209 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:16,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:16,209 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-19 14:53:16,209 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:16,209 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,209 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:16,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,209 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:16,210 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:16,210 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:16,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-19 14:53:16,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:16,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:16,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:16,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:16,310 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:16,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:16,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:16,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:16,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,328 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:16,328 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:16,328 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-19 14:53:16,328 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-19 14:53:16,329 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,329 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,330 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,330 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:16,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:16,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:16,331 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:16,331 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:16,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:16,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,332 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,332 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-19 14:53:16,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:16,332 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-19 14:53:16,332 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:16,333 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-19 14:53:16,333 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:16,333 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:16,333 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:16,333 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. started... 2023-03-19 14:53:16,334 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 62083c107c616f5c217d55e9a72a6e21 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:16,761 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a893f5157abe4a2c8f7ea225308460c4 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907a893f5157abe4a2c8f7ea225308460c4 2023-03-19 14:53:17,198 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/2ec876a299134cfb98c4ee93fffb4a5e 2023-03-19 14:53:17,206 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/2ec876a299134cfb98c4ee93fffb4a5e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/2ec876a299134cfb98c4ee93fffb4a5e 2023-03-19 14:53:17,213 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/2ec876a299134cfb98c4ee93fffb4a5e, entries=1, sequenceid=37, filesize=5.0 K 2023-03-19 14:53:17,215 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 62083c107c616f5c217d55e9a72a6e21 in 881ms, sequenceid=37, compaction requested=true 2023-03-19 14:53:17,215 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:17,215 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:17,215 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:17,215 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:17,215 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,215 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-19 14:53:17,215 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-19 14:53:17,217 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,217 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:17,217 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,217 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:17,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-19 14:53:17,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26f771ca[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:17,219 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-19 14:53:17,219 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,219 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,220 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-19 14:53:17,220 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-19 14:53:17,220 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:17,220 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,220 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:17,221 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-19 14:53:17,221 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,221 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,221 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-19 14:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:17,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:17,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-19 14:53:17,224 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-19 14:53:17,224 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:17,224 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:17,224 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,224 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:17,225 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,225 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:17,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,225 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:17,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:17,226 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:17,227 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:17,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:17,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:17,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,229 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:17,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:17,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:17,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:17,230 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-19 14:53:17,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:17,230 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:17,230 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:17,330 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:17,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:17,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:17,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:17,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,341 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:17,341 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:17,342 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-19 14:53:17,342 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-19 14:53:17,342 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,342 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,343 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,343 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:17,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:17,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:17,343 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:17,343 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:17,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:17,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,345 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,345 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-19 14:53:17,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:17,346 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-19 14:53:17,346 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:17,347 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-19 14:53:17,347 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:17,347 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:17,347 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:17,347 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. started... 2023-03-19 14:53:17,347 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 62083c107c616f5c217d55e9a72a6e21 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:17,773 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b56b1fcb569f492194a09fb3f0e18de3 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b56b1fcb569f492194a09fb3f0e18de3 2023-03-19 14:53:18,219 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/8fc09d33d7ad480d8e1daade60235a6b 2023-03-19 14:53:18,230 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/8fc09d33d7ad480d8e1daade60235a6b as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8fc09d33d7ad480d8e1daade60235a6b 2023-03-19 14:53:18,238 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8fc09d33d7ad480d8e1daade60235a6b, entries=1, sequenceid=41, filesize=5.0 K 2023-03-19 14:53:18,239 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 62083c107c616f5c217d55e9a72a6e21 in 892ms, sequenceid=41, compaction requested=true 2023-03-19 14:53:18,239 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:18,239 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:18,239 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:18,240 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:18,240 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,240 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-19 14:53:18,240 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-19 14:53:18,241 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,241 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:18,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:18,242 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,242 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:18,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:18,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:18,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:18,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-19 14:53:18,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17e25825[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:18,243 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-19 14:53:18,243 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,246 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,246 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-19 14:53:18,246 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-19 14:53:18,246 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:18,246 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,246 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:18,247 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-19 14:53:18,247 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,247 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,247 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-19 14:53:18,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:18,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:18,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:18,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:18,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:18,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:18,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-19 14:53:18,256 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-19 14:53:18,256 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:18,256 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:18,256 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,256 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:18,262 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,263 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,263 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:18,263 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,264 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:18,267 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:18,267 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,267 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,267 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,267 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:18,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-19 14:53:18,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:18,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-19 14:53:18,267 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,267 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:18,267 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,267 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:18,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:18,267 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:18,267 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:18,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:18,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:18,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:18,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-19 14:53:18,368 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:18,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:18,375 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-19 14:53:18,378 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49658, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-19 14:53:18,379 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:18,392 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-19 14:53:18,392 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-19 14:53:18,394 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238198394 2023-03-19 14:53:18,394 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:53:18,395 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:53:18,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-19 14:53:18,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-19 14:53:18,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x7d820848 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:53:18,403 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e03c68c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:53:18,405 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:19,275 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031e6ba8b02439451d8ec4be06ae4e90b2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031e6ba8b02439451d8ec4be06ae4e90b2 2023-03-19 14:53:19,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-19 14:53:19,292 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:53:19,293 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58450, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:53:19,305 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:53:19,306 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49662, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:53:19,341 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/296d00f3bdd94d4e8d8c31acebcf35d5 first=Optional[r3] last=Optional[r6] 2023-03-19 14:53:19,353 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/296d00f3bdd94d4e8d8c31acebcf35d5}] 2023-03-19 14:53:19,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/296d00f3bdd94d4e8d8c31acebcf35d5 for inclusion in 62083c107c616f5c217d55e9a72a6e21/family1 2023-03-19 14:53:19,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-19 14:53:19,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:53:19,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:19,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/296d00f3bdd94d4e8d8c31acebcf35d5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1mctn194ts2ir94653jrb5sgs4c44tbmo1013eo1lls35aod58ksbsiocma5t35p/family1/296d00f3bdd94d4e8d8c31acebcf35d5 2023-03-19 14:53:19,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1mctn194ts2ir94653jrb5sgs4c44tbmo1013eo1lls35aod58ksbsiocma5t35p/family1/296d00f3bdd94d4e8d8c31acebcf35d5 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/45265602fcb4492e882a30298fb166de_SeqId_44_ 2023-03-19 14:53:19,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1mctn194ts2ir94653jrb5sgs4c44tbmo1013eo1lls35aod58ksbsiocma5t35p/family1/296d00f3bdd94d4e8d8c31acebcf35d5 into 62083c107c616f5c217d55e9a72a6e21/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/45265602fcb4492e882a30298fb166de_SeqId_44_ - updating store file list. 2023-03-19 14:53:19,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/45265602fcb4492e882a30298fb166de_SeqId_44_ into 62083c107c616f5c217d55e9a72a6e21/family1 2023-03-19 14:53:19,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1mctn194ts2ir94653jrb5sgs4c44tbmo1013eo1lls35aod58ksbsiocma5t35p/family1/296d00f3bdd94d4e8d8c31acebcf35d5 into 62083c107c616f5c217d55e9a72a6e21/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/45265602fcb4492e882a30298fb166de_SeqId_44_) 2023-03-19 14:53:19,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1mctn194ts2ir94653jrb5sgs4c44tbmo1013eo1lls35aod58ksbsiocma5t35p/family1/296d00f3bdd94d4e8d8c31acebcf35d5 2023-03-19 14:53:19,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-19 14:53:19,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-19 14:53:19,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 62083c107c616f5c217d55e9a72a6e21/family1 is initiating minor compaction 2023-03-19 14:53:19,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@43558e71; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:19,423 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 62083c107c616f5c217d55e9a72a6e21/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:19,428 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/d5832784e738423382cfa08e9d0185ff, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/676c1007a87f4cf081f6f3a000369857, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/83593cc1751647ec997c2e110b396162, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/1ec2273a55a74c65b81570e99ae73b3c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/f4aaeaf8be68430a92cb774fd7788b44, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8146a423452b4ea6b122b9610715891f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/e232f01eb01646d2b311db13c105b573, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/2ec876a299134cfb98c4ee93fffb4a5e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8fc09d33d7ad480d8e1daade60235a6b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/45265602fcb4492e882a30298fb166de_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp, totalSize=50.2 K 2023-03-19 14:53:19,429 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting d5832784e738423382cfa08e9d0185ff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-19 14:53:19,429 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 676c1007a87f4cf081f6f3a000369857, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-19 14:53:19,429 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 83593cc1751647ec997c2e110b396162, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-19 14:53:19,429 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 1ec2273a55a74c65b81570e99ae73b3c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-19 14:53:19,429 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting f4aaeaf8be68430a92cb774fd7788b44, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-19 14:53:19,429 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 8146a423452b4ea6b122b9610715891f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-19 14:53:19,429 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting e232f01eb01646d2b311db13c105b573, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-19 14:53:19,429 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 2ec876a299134cfb98c4ee93fffb4a5e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-19 14:53:19,430 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 8fc09d33d7ad480d8e1daade60235a6b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-19 14:53:19,430 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 45265602fcb4492e882a30298fb166de_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-19 14:53:19,452 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-19 14:53:19,459 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:19,467 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e039c009b91d4282979882b87b7f91f1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e039c009b91d4282979882b87b7f91f1 2023-03-19 14:53:19,472 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310b720116a8174571b46dfb64fd5df3f1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512310b720116a8174571b46dfb64fd5df3f1 2023-03-19 14:53:19,478 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ca7c82a89d304c7fb22aa2d307fc6407 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ca7c82a89d304c7fb22aa2d307fc6407 2023-03-19 14:53:19,480 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030aea186e63344f13b46b68993c7fb050 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601030aea186e63344f13b46b68993c7fb050 2023-03-19 14:53:19,481 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-19 14:53:19,481 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-19 14:53:19,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:19,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:19,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:19,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:19,482 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:19,482 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:19,482 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:19,482 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:19,532 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 62083c107c616f5c217d55e9a72a6e21#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:53:19,637 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058b13b349c1cd4f9d819e0bc67f88fd69 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512058b13b349c1cd4f9d819e0bc67f88fd69 2023-03-19 14:53:19,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-19 14:53:19,700 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7e4ffc6dbe08480b88c4f7c2f0a3e0ea first=Optional[r00] last=Optional[r2] 2023-03-19 14:53:19,701 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7e4ffc6dbe08480b88c4f7c2f0a3e0ea}] 2023-03-19 14:53:19,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7e4ffc6dbe08480b88c4f7c2f0a3e0ea for inclusion in 62083c107c616f5c217d55e9a72a6e21/family1 2023-03-19 14:53:19,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-19 14:53:19,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:53:19,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:19,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7e4ffc6dbe08480b88c4f7c2f0a3e0ea to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bn1o6bm5pmva4cmf6r73tjdqobpij9i49ogm2bgeak84gulsusr2ksmqp8m92iol/family1/7e4ffc6dbe08480b88c4f7c2f0a3e0ea 2023-03-19 14:53:19,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bn1o6bm5pmva4cmf6r73tjdqobpij9i49ogm2bgeak84gulsusr2ksmqp8m92iol/family1/7e4ffc6dbe08480b88c4f7c2f0a3e0ea as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/91a04b70440245648e6d09981affba54_SeqId_46_ 2023-03-19 14:53:19,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bn1o6bm5pmva4cmf6r73tjdqobpij9i49ogm2bgeak84gulsusr2ksmqp8m92iol/family1/7e4ffc6dbe08480b88c4f7c2f0a3e0ea into 62083c107c616f5c217d55e9a72a6e21/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/91a04b70440245648e6d09981affba54_SeqId_46_ - updating store file list. 2023-03-19 14:53:19,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/91a04b70440245648e6d09981affba54_SeqId_46_ into 62083c107c616f5c217d55e9a72a6e21/family1 2023-03-19 14:53:19,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bn1o6bm5pmva4cmf6r73tjdqobpij9i49ogm2bgeak84gulsusr2ksmqp8m92iol/family1/7e4ffc6dbe08480b88c4f7c2f0a3e0ea into 62083c107c616f5c217d55e9a72a6e21/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/91a04b70440245648e6d09981affba54_SeqId_46_) 2023-03-19 14:53:19,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__bn1o6bm5pmva4cmf6r73tjdqobpij9i49ogm2bgeak84gulsusr2ksmqp8m92iol/family1/7e4ffc6dbe08480b88c4f7c2f0a3e0ea 2023-03-19 14:53:19,735 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-19 14:53:19,736 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:19,739 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113033fc74d49e47440b803e063b08ec0dc0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113033fc74d49e47440b803e063b08ec0dc0 2023-03-19 14:53:19,740 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120111741b52613240bdb84d168ac5496ead to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120111741b52613240bdb84d168ac5496ead 2023-03-19 14:53:19,742 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512051db437975d664907b3e9bca62a327332 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512051db437975d664907b3e9bca62a327332 2023-03-19 14:53:19,743 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-19 14:53:19,743 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-19 14:53:19,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:19,744 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-19 14:53:19,744 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:53:19,745 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-19 14:53:19,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.3600 sec 2023-03-19 14:53:19,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-19 14:53:19,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:19,952 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-19 14:53:19,954 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-19 14:53:19,954 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-19 14:53:19,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-19 14:53:19,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=62083c107c616f5c217d55e9a72a6e21, REOPEN/MOVE}] 2023-03-19 14:53:19,996 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=62083c107c616f5c217d55e9a72a6e21, REOPEN/MOVE 2023-03-19 14:53:19,999 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=62083c107c616f5c217d55e9a72a6e21, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:19,999 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679237599999"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237599999"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237599999"}]},"ts":"1679237599999"} 2023-03-19 14:53:20,003 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 62083c107c616f5c217d55e9a72a6e21, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:20,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:20,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 62083c107c616f5c217d55e9a72a6e21, disabling compactions & flushes 2023-03-19 14:53:20,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:20,408 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/0bf916a21aa24de6aa83dac29c1d409e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/0bf916a21aa24de6aa83dac29c1d409e 2023-03-19 14:53:20,420 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 62083c107c616f5c217d55e9a72a6e21/family1 of 62083c107c616f5c217d55e9a72a6e21 into 0bf916a21aa24de6aa83dac29c1d409e(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:53:20,420 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:20,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:20,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:20,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. after waiting 0 ms 2023-03-19 14:53:20,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:20,429 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1679237599422; duration=0sec 2023-03-19 14:53:20,431 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:20,433 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/d5832784e738423382cfa08e9d0185ff, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/676c1007a87f4cf081f6f3a000369857, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/83593cc1751647ec997c2e110b396162, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/1ec2273a55a74c65b81570e99ae73b3c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/f4aaeaf8be68430a92cb774fd7788b44, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8146a423452b4ea6b122b9610715891f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/e232f01eb01646d2b311db13c105b573, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/2ec876a299134cfb98c4ee93fffb4a5e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8fc09d33d7ad480d8e1daade60235a6b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/45265602fcb4492e882a30298fb166de_SeqId_44_] to archive 2023-03-19 14:53:20,434 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:20,437 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/d5832784e738423382cfa08e9d0185ff to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/d5832784e738423382cfa08e9d0185ff 2023-03-19 14:53:20,438 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/676c1007a87f4cf081f6f3a000369857 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/676c1007a87f4cf081f6f3a000369857 2023-03-19 14:53:20,442 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/83593cc1751647ec997c2e110b396162 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/83593cc1751647ec997c2e110b396162 2023-03-19 14:53:20,444 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/1ec2273a55a74c65b81570e99ae73b3c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/1ec2273a55a74c65b81570e99ae73b3c 2023-03-19 14:53:20,446 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/f4aaeaf8be68430a92cb774fd7788b44 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/f4aaeaf8be68430a92cb774fd7788b44 2023-03-19 14:53:20,447 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8146a423452b4ea6b122b9610715891f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8146a423452b4ea6b122b9610715891f 2023-03-19 14:53:20,449 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/e232f01eb01646d2b311db13c105b573 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/e232f01eb01646d2b311db13c105b573 2023-03-19 14:53:20,451 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/2ec876a299134cfb98c4ee93fffb4a5e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/2ec876a299134cfb98c4ee93fffb4a5e 2023-03-19 14:53:20,452 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8fc09d33d7ad480d8e1daade60235a6b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/8fc09d33d7ad480d8e1daade60235a6b 2023-03-19 14:53:20,454 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/45265602fcb4492e882a30298fb166de_SeqId_44_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/45265602fcb4492e882a30298fb166de_SeqId_44_ 2023-03-19 14:53:20,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-03-19 14:53:20,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:20,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:20,489 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 62083c107c616f5c217d55e9a72a6e21 to self. 2023-03-19 14:53:20,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:20,493 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=62083c107c616f5c217d55e9a72a6e21, regionState=CLOSED 2023-03-19 14:53:20,493 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679237600492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237600492"}]},"ts":"1679237600492"} 2023-03-19 14:53:20,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-19 14:53:20,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 62083c107c616f5c217d55e9a72a6e21, server=jenkins-hbase20.apache.org,33191,1679237584457 in 492 msec 2023-03-19 14:53:20,500 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=62083c107c616f5c217d55e9a72a6e21, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=true 2023-03-19 14:53:20,650 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=62083c107c616f5c217d55e9a72a6e21, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:20,650 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679237600650"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237600650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237600650"}]},"ts":"1679237600650"} 2023-03-19 14:53:20,653 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 62083c107c616f5c217d55e9a72a6e21, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:20,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:20,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 62083c107c616f5c217d55e9a72a6e21, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:53:20,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:20,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:20,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:20,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:20,817 INFO [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:20,819 DEBUG [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1 2023-03-19 14:53:20,820 DEBUG [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1 2023-03-19 14:53:20,820 INFO [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 62083c107c616f5c217d55e9a72a6e21 columnFamilyName family1 2023-03-19 14:53:20,833 DEBUG [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/0bf916a21aa24de6aa83dac29c1d409e 2023-03-19 14:53:20,844 DEBUG [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/91a04b70440245648e6d09981affba54_SeqId_46_ 2023-03-19 14:53:20,850 DEBUG [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/981939d5d3634acb9756eecfb53fab75 2023-03-19 14:53:20,850 INFO [StoreOpener-62083c107c616f5c217d55e9a72a6e21-1] regionserver.HStore(310): Store=62083c107c616f5c217d55e9a72a6e21/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:20,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:20,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:20,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:53:20,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 62083c107c616f5c217d55e9a72a6e21; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65791163, jitterRate=-0.01963527500629425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:53:20,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:20,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21., pid=17, masterSystemTime=1679237600805 2023-03-19 14:53:20,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:20,858 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-19 14:53:20,860 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-19 14:53:20,860 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1912): 62083c107c616f5c217d55e9a72a6e21/family1 is initiating minor compaction (all files) 2023-03-19 14:53:20,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:20,860 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 62083c107c616f5c217d55e9a72a6e21/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:20,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:53:20,860 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/981939d5d3634acb9756eecfb53fab75, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/0bf916a21aa24de6aa83dac29c1d409e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/91a04b70440245648e6d09981affba54_SeqId_46_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp, totalSize=358.6 K 2023-03-19 14:53:20,861 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=62083c107c616f5c217d55e9a72a6e21, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:20,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 981939d5d3634acb9756eecfb53fab75, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878808483 2023-03-19 14:53:20,861 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1679237600861"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237600861"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237600861"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237600861"}]},"ts":"1679237600861"} 2023-03-19 14:53:20,862 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 0bf916a21aa24de6aa83dac29c1d409e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621208483 2023-03-19 14:53:20,862 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 91a04b70440245648e6d09981affba54_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878808483 2023-03-19 14:53:20,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-19 14:53:20,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 62083c107c616f5c217d55e9a72a6e21, server=jenkins-hbase20.apache.org,33191,1679237584457 in 210 msec 2023-03-19 14:53:20,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-19 14:53:20,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=62083c107c616f5c217d55e9a72a6e21, REOPEN/MOVE in 873 msec 2023-03-19 14:53:20,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-19 14:53:20,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 911 msec 2023-03-19 14:53:20,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 951 msec 2023-03-19 14:53:20,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-19 14:53:20,889 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(278): alter status finished 2023-03-19 14:53:20,890 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-19 14:53:20,892 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-19 14:53:20,898 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-19 14:53:20,900 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:53:20,900 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238200900 2023-03-19 14:53:20,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:53:20,904 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-19 14:53:20,904 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-19 14:53:20,904 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x075e7d7f to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:53:20,908 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 62083c107c616f5c217d55e9a72a6e21#family1#compaction#11 average throughput is 4.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:53:20,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55aad17f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:53:20,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:20,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:20,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:20,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:20,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:21,352 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/.tmp/family1/e2dc4e91018e4e8abcb78111d589063e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/e2dc4e91018e4e8abcb78111d589063e 2023-03-19 14:53:21,359 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 62083c107c616f5c217d55e9a72a6e21/family1 of 62083c107c616f5c217d55e9a72a6e21 into e2dc4e91018e4e8abcb78111d589063e(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:53:21,359 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:21,359 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21., storeName=62083c107c616f5c217d55e9a72a6e21/family1, priority=13, startTime=1679237600857; duration=0sec 2023-03-19 14:53:21,360 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:21,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/981939d5d3634acb9756eecfb53fab75, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/0bf916a21aa24de6aa83dac29c1d409e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/91a04b70440245648e6d09981affba54_SeqId_46_] to archive 2023-03-19 14:53:21,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:21,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/981939d5d3634acb9756eecfb53fab75 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/981939d5d3634acb9756eecfb53fab75 2023-03-19 14:53:21,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/0bf916a21aa24de6aa83dac29c1d409e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/0bf916a21aa24de6aa83dac29c1d409e 2023-03-19 14:53:21,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/91a04b70440245648e6d09981affba54_SeqId_46_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/91a04b70440245648e6d09981affba54_SeqId_46_ 2023-03-19 14:53:21,762 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289f17c491d0e2438a942de0baad4c803f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511289f17c491d0e2438a942de0baad4c803f 2023-03-19 14:53:21,764 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-19 14:53:21,779 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:53:21,780 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51444, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:53:21,788 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:53:21,790 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39218, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:53:21,801 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/74180ac64abc40f69a4071b889032b2d first=Optional[r05] last=Optional[r8] 2023-03-19 14:53:21,802 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=50 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/74180ac64abc40f69a4071b889032b2d}] 2023-03-19 14:53:21,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/74180ac64abc40f69a4071b889032b2d for inclusion in 62083c107c616f5c217d55e9a72a6e21/family1 2023-03-19 14:53:21,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-19 14:53:21,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:53:21,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:53:21,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/74180ac64abc40f69a4071b889032b2d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oc4d1lv4npqa97oadud2iti90umm2ltptljjpekjevse580tv7q5sb586srnnjg6/family1/74180ac64abc40f69a4071b889032b2d 2023-03-19 14:53:21,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oc4d1lv4npqa97oadud2iti90umm2ltptljjpekjevse580tv7q5sb586srnnjg6/family1/74180ac64abc40f69a4071b889032b2d as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/f0396a9a1e6a400aaf8af97ab046b184_SeqId_53_ 2023-03-19 14:53:21,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oc4d1lv4npqa97oadud2iti90umm2ltptljjpekjevse580tv7q5sb586srnnjg6/family1/74180ac64abc40f69a4071b889032b2d into 62083c107c616f5c217d55e9a72a6e21/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/f0396a9a1e6a400aaf8af97ab046b184_SeqId_53_ - updating store file list. 2023-03-19 14:53:21,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/f0396a9a1e6a400aaf8af97ab046b184_SeqId_53_ into 62083c107c616f5c217d55e9a72a6e21/family1 2023-03-19 14:53:21,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oc4d1lv4npqa97oadud2iti90umm2ltptljjpekjevse580tv7q5sb586srnnjg6/family1/74180ac64abc40f69a4071b889032b2d into 62083c107c616f5c217d55e9a72a6e21/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/family1/f0396a9a1e6a400aaf8af97ab046b184_SeqId_53_) 2023-03-19 14:53:21,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__oc4d1lv4npqa97oadud2iti90umm2ltptljjpekjevse580tv7q5sb586srnnjg6/family1/74180ac64abc40f69a4071b889032b2d 2023-03-19 14:53:21,826 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-19 14:53:21,827 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:21,829 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b56b1fcb569f492194a09fb3f0e18de3 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b56b1fcb569f492194a09fb3f0e18de3 2023-03-19 14:53:21,831 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112855e3ae9049864314933358d248338996 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112855e3ae9049864314933358d248338996 2023-03-19 14:53:21,831 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-19 14:53:21,831 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-19 14:53:21,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:21,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:21,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-19 14:53:21,831 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-19 14:53:21,832 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:53:21,833 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-19 14:53:21,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 942 msec 2023-03-19 14:53:21,957 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=248 (was 209) Potentially hanging thread: hconnection-0x72692c9b-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56848 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56612 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72692c9b-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56762 [Waiting for operation #37] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56636 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1050568762_15 at /127.0.0.1:56862 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56323@0x075e7d7f-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x72692c9b-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase20:33191-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56654 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3dce5f6e-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56323@0x7d820848-SendThread(127.0.0.1:56323) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56792 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56668 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3dce5f6e-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56888 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56816 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:35850 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56692 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3dce5f6e-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56323@0x7d820848 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1900094437.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72692c9b-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x72692c9b-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56323@0x7d820848-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56323@0x075e7d7f-SendThread(127.0.0.1:56323) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56682 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:56776 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56323@0x075e7d7f sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1900094437.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=586 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=306 (was 346), ProcessCount=168 (was 168), AvailableMemoryMB=4565 (was 4999) 2023-03-19 14:53:21,969 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=586, MaxFileDescriptor=60000, SystemLoadAverage=306, ProcessCount=168, AvailableMemoryMB=4564 2023-03-19 14:53:21,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-19 14:53:21,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:21,975 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:53:21,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-19 14:53:21,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-19 14:53:21,977 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:53:21,978 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f 2023-03-19 14:53:21,979 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f empty. 2023-03-19 14:53:21,979 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f 2023-03-19 14:53:21,980 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-19 14:53:21,988 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-19 14:53:21,990 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 35f669f3cf30647988751ec77768992f, NAME => 'testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:53:21,999 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:21,999 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 35f669f3cf30647988751ec77768992f, disabling compactions & flushes 2023-03-19 14:53:21,999 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:21,999 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:21,999 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. after waiting 0 ms 2023-03-19 14:53:21,999 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:21,999 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:21,999 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:22,002 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:53:22,003 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679237602003"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237602003"}]},"ts":"1679237602003"} 2023-03-19 14:53:22,005 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-19 14:53:22,006 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:53:22,006 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237602006"}]},"ts":"1679237602006"} 2023-03-19 14:53:22,008 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-19 14:53:22,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=35f669f3cf30647988751ec77768992f, ASSIGN}] 2023-03-19 14:53:22,012 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=35f669f3cf30647988751ec77768992f, ASSIGN 2023-03-19 14:53:22,013 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=35f669f3cf30647988751ec77768992f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:53:22,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-19 14:53:22,164 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=35f669f3cf30647988751ec77768992f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:22,164 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679237602164"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237602164"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237602164"}]},"ts":"1679237602164"} 2023-03-19 14:53:22,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 35f669f3cf30647988751ec77768992f, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:22,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-19 14:53:22,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:22,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 35f669f3cf30647988751ec77768992f, NAME => 'testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:53:22,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 35f669f3cf30647988751ec77768992f 2023-03-19 14:53:22,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:22,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 35f669f3cf30647988751ec77768992f 2023-03-19 14:53:22,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 35f669f3cf30647988751ec77768992f 2023-03-19 14:53:22,330 INFO [StoreOpener-35f669f3cf30647988751ec77768992f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 35f669f3cf30647988751ec77768992f 2023-03-19 14:53:22,331 DEBUG [StoreOpener-35f669f3cf30647988751ec77768992f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1 2023-03-19 14:53:22,331 DEBUG [StoreOpener-35f669f3cf30647988751ec77768992f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1 2023-03-19 14:53:22,332 INFO [StoreOpener-35f669f3cf30647988751ec77768992f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35f669f3cf30647988751ec77768992f columnFamilyName family1 2023-03-19 14:53:22,336 INFO [StoreOpener-35f669f3cf30647988751ec77768992f-1] regionserver.HStore(310): Store=35f669f3cf30647988751ec77768992f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:22,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f 2023-03-19 14:53:22,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f 2023-03-19 14:53:22,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 35f669f3cf30647988751ec77768992f 2023-03-19 14:53:22,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:53:22,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 35f669f3cf30647988751ec77768992f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61598477, jitterRate=-0.0821111649274826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:53:22,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:22,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f., pid=21, masterSystemTime=1679237602320 2023-03-19 14:53:22,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:22,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:22,351 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=35f669f3cf30647988751ec77768992f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:22,352 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679237602351"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237602351"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237602351"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237602351"}]},"ts":"1679237602351"} 2023-03-19 14:53:22,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-19 14:53:22,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 35f669f3cf30647988751ec77768992f, server=jenkins-hbase20.apache.org,33191,1679237584457 in 187 msec 2023-03-19 14:53:22,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-19 14:53:22,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=35f669f3cf30647988751ec77768992f, ASSIGN in 348 msec 2023-03-19 14:53:22,364 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:53:22,365 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237602364"}]},"ts":"1679237602364"} 2023-03-19 14:53:22,368 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-19 14:53:22,371 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:53:22,373 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 399 msec 2023-03-19 14:53:22,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-19 14:53:22,582 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-19 14:53:22,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:22,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:22,634 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:22,634 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:22,636 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:53:22,636 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:22,637 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:22,637 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:22,638 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:22,638 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:22,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:22,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:22,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:22,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:22,639 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:22,640 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:22,640 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:53:22,640 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:22,642 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:53:22,642 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:22,642 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:22,642 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:22,642 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. started... 2023-03-19 14:53:22,644 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:22,644 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:22,646 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35f669f3cf30647988751ec77768992f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-19 14:53:23,117 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b30f464980ac4d9bbba1daa22179a251 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b30f464980ac4d9bbba1daa22179a251 2023-03-19 14:53:23,526 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/9b426796a44a475f9e46a73a58e9ea53 2023-03-19 14:53:23,535 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/9b426796a44a475f9e46a73a58e9ea53 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/9b426796a44a475f9e46a73a58e9ea53 2023-03-19 14:53:23,549 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/9b426796a44a475f9e46a73a58e9ea53, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-19 14:53:23,554 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 35f669f3cf30647988751ec77768992f in 908ms, sequenceid=5, compaction requested=false 2023-03-19 14:53:23,554 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:23,555 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:23,555 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:23,555 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:23,555 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:23,556 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,556 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:53:23,556 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:53:23,557 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,557 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:23,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:23,558 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,558 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:23,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:23,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:23,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:23,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:53:23,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@519f556f[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:23,565 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:23,565 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,570 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,571 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:23,571 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:53:23,571 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:23,572 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:53:23,572 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:23,572 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:53:23,573 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,574 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:23,574 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:23,574 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:53:23,574 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:23,574 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:23,574 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,574 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:23,576 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,576 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:23,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,578 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:23,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:23,582 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:23,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:23,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:23,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,587 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,598 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:23,598 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:23,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:23,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:23,598 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:23,598 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,598 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:23,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:23,598 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,599 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,599 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,599 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,599 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,599 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:23,599 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:23,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:53:23,699 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:23,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:23,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:23,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:23,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,710 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:23,710 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:23,711 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:53:23,711 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:23,712 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,712 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,713 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,713 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:23,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,714 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:23,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,714 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,714 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,715 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:53:23,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:23,715 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:53:23,715 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:23,716 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:53:23,716 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:23,716 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:23,716 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:23,716 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. started... 2023-03-19 14:53:23,716 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35f669f3cf30647988751ec77768992f 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-19 14:53:23,748 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c014a2a71ef640f5bce91ceb3675c55f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c014a2a71ef640f5bce91ceb3675c55f 2023-03-19 14:53:24,156 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/4ed31e99525140f1959814edc00c0d2a 2023-03-19 14:53:24,164 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/4ed31e99525140f1959814edc00c0d2a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/4ed31e99525140f1959814edc00c0d2a 2023-03-19 14:53:24,177 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/4ed31e99525140f1959814edc00c0d2a, entries=1, sequenceid=9, filesize=5.0 K 2023-03-19 14:53:24,178 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 35f669f3cf30647988751ec77768992f in 462ms, sequenceid=9, compaction requested=false 2023-03-19 14:53:24,178 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:24,179 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:24,179 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:24,179 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:24,179 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,179 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:53:24,179 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:53:24,180 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,180 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:24,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:24,181 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,181 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:24,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:24,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:24,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:24,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:53:24,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f231a84[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:24,186 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:24,186 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,187 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,187 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:24,187 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,188 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:24,188 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:53:24,188 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:24,188 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,188 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:53:24,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:24,189 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:24,189 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:53:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:24,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:24,192 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:53:24,192 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:24,192 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:24,192 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,192 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:24,193 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,193 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,193 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:24,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:24,193 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,195 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:24,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:24,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:24,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,198 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:24,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:24,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:24,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:24,199 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:24,199 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:24,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:53:24,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:24,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:24,299 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:24,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:24,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:24,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:24,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,309 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:24,309 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:24,309 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:53:24,309 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:24,310 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,310 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,311 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,311 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:24,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:24,311 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,311 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:24,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,312 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,312 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:53:24,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,312 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:53:24,312 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:24,313 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:53:24,313 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:24,313 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:24,313 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:24,313 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. started... 2023-03-19 14:53:24,313 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35f669f3cf30647988751ec77768992f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:24,333 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ed4c615b6fcb451185898cb3318dc742 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ed4c615b6fcb451185898cb3318dc742 2023-03-19 14:53:24,740 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/cc0d4371593e4a279707c4149acfced4 2023-03-19 14:53:24,749 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/cc0d4371593e4a279707c4149acfced4 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/cc0d4371593e4a279707c4149acfced4 2023-03-19 14:53:24,759 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/cc0d4371593e4a279707c4149acfced4, entries=1, sequenceid=13, filesize=4.9 K 2023-03-19 14:53:24,760 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35f669f3cf30647988751ec77768992f in 447ms, sequenceid=13, compaction requested=true 2023-03-19 14:53:24,760 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:24,760 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:24,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:24,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:24,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:53:24,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:53:24,763 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,764 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,764 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,764 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:24,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:24,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:24,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:24,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:53:24,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72c75f8b[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:24,768 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:24,768 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,770 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,770 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:24,770 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:53:24,770 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:24,771 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,771 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:24,771 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:53:24,771 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,771 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:24,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:24,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:24,772 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:53:24,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:24,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:24,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:24,780 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:24,780 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:53:24,780 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:24,780 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:24,780 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,780 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:24,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:24,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,787 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:24,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:24,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:24,791 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:24,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,796 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:24,796 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,797 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,797 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,797 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,797 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,797 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:24,797 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:24,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:24,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:24,797 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,798 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:53:24,798 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:24,798 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:24,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:24,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:24,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:24,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:24,898 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:24,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:24,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:24,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:24,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,908 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:24,908 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:24,909 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:53:24,909 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:24,910 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,910 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,911 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,911 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:24,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:24,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:24,911 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:24,911 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:24,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,912 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,912 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:53:24,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:24,912 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:53:24,912 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:24,913 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:53:24,913 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:24,913 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:24,913 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:24,913 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. started... 2023-03-19 14:53:24,913 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35f669f3cf30647988751ec77768992f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:25,334 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205667321d8887a4d79a3dae523c9925589 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205667321d8887a4d79a3dae523c9925589 2023-03-19 14:53:25,743 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/fa4d7c9ef53d4611ac209dba8734ad0f 2023-03-19 14:53:25,752 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/fa4d7c9ef53d4611ac209dba8734ad0f as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fa4d7c9ef53d4611ac209dba8734ad0f 2023-03-19 14:53:25,759 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fa4d7c9ef53d4611ac209dba8734ad0f, entries=1, sequenceid=17, filesize=4.9 K 2023-03-19 14:53:25,760 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35f669f3cf30647988751ec77768992f in 847ms, sequenceid=17, compaction requested=true 2023-03-19 14:53:25,760 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:25,760 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:25,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:25,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:25,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:53:25,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:53:25,761 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,761 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:25,762 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,762 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:25,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:53:25,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77e10286[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:25,763 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:25,763 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,764 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,764 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:25,764 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:53:25,764 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:25,764 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,764 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:25,765 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:53:25,765 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,765 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:25,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:25,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:25,765 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:53:25,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:25,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:25,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:25,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:25,769 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:53:25,769 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:25,769 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:25,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:25,769 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,769 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:25,778 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,778 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,778 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:25,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:25,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:25,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:25,780 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:25,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,785 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:25,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:25,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:25,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:25,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,788 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:25,788 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:25,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:25,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:25,789 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:25,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:25,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:25,789 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:25,889 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:25,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:25,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:25,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:25,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,898 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:25,898 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:25,898 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:53:25,899 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:25,899 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,899 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,900 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:25,900 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:25,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:25,900 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:25,900 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,901 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,901 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:53:25,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:25,902 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:53:25,902 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:25,902 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:53:25,902 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:25,902 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:25,903 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:25,903 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. started... 2023-03-19 14:53:25,903 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35f669f3cf30647988751ec77768992f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:26,022 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:53:26,320 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122887c16508ba5b4996a57175bc7ecbffa5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122887c16508ba5b4996a57175bc7ecbffa5 2023-03-19 14:53:26,728 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/b286e736ced04070837c5fa59953ea6f 2023-03-19 14:53:26,742 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/b286e736ced04070837c5fa59953ea6f as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/b286e736ced04070837c5fa59953ea6f 2023-03-19 14:53:26,750 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/b286e736ced04070837c5fa59953ea6f, entries=1, sequenceid=21, filesize=4.9 K 2023-03-19 14:53:26,751 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35f669f3cf30647988751ec77768992f in 848ms, sequenceid=21, compaction requested=true 2023-03-19 14:53:26,751 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:26,751 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:26,751 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:26,751 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:26,751 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,751 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:53:26,751 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:53:26,753 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,753 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:26,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:26,753 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,753 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:26,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:26,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:26,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:26,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:53:26,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cfe1538[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:26,755 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:26,755 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,755 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,755 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:26,755 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:53:26,755 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,756 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:26,755 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:26,756 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:53:26,756 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,756 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:26,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:26,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:26,756 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:53:26,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:26,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:26,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:26,759 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:53:26,759 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:26,759 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:26,759 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,759 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:26,762 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,762 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,762 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:26,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:26,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:26,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:26,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:26,763 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,763 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:26,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,765 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,765 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,765 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,765 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,765 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:26,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:53:26,765 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:26,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:26,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:26,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:26,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:26,765 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:26,765 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,766 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,766 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,766 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:26,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:26,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:26,766 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:26,866 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:26,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:26,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:26,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:26,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,882 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:26,882 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:26,883 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:53:26,883 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:26,883 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,884 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,885 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:26,885 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:26,885 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:26,885 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,886 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,887 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:53:26,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:26,887 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:53:26,887 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:26,887 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:53:26,887 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:26,887 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:26,887 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:26,887 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. started... 2023-03-19 14:53:26,887 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35f669f3cf30647988751ec77768992f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:27,305 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123152cb1696f4fa4a0eb76f195c5eda975e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123152cb1696f4fa4a0eb76f195c5eda975e 2023-03-19 14:53:27,715 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/7e8b960cf51a4e71a09421ed170b5855 2023-03-19 14:53:27,721 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/7e8b960cf51a4e71a09421ed170b5855 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/7e8b960cf51a4e71a09421ed170b5855 2023-03-19 14:53:27,727 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/7e8b960cf51a4e71a09421ed170b5855, entries=1, sequenceid=25, filesize=4.9 K 2023-03-19 14:53:27,728 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35f669f3cf30647988751ec77768992f in 841ms, sequenceid=25, compaction requested=true 2023-03-19 14:53:27,728 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:27,728 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:27,728 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:27,729 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:27,729 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,729 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:53:27,729 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:53:27,730 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,730 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:27,730 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,730 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:27,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:27,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:53:27,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bfed319[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:27,732 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:27,732 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,733 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,733 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:27,733 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:53:27,733 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,733 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:27,733 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:27,734 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,734 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:53:27,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:27,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:27,734 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:27,734 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:53:27,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:27,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:27,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:27,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:27,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:27,737 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:53:27,737 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:27,737 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:27,737 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,737 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:27,739 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,739 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,739 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:27,739 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:27,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,740 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:27,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,742 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,742 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:27,742 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:27,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:27,742 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:27,742 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:27,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:27,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:27,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:53:27,742 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:27,743 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:27,743 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,743 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,743 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:27,743 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,743 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:27,843 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:27,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:27,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:27,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:27,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,857 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:27,857 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:27,858 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:53:27,858 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:27,859 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,859 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,860 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:27,860 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:27,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:27,861 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:27,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,861 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:27,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:27,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,863 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,863 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:53:27,863 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:27,863 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:53:27,864 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:27,864 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:53:27,865 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:27,865 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:27,865 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:27,865 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. started... 2023-03-19 14:53:27,865 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35f669f3cf30647988751ec77768992f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:28,291 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010153b9aa645a794af58889a5ea976c4651 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010153b9aa645a794af58889a5ea976c4651 2023-03-19 14:53:28,699 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/3ace8d8a79354779ab6173a69e6a1942 2023-03-19 14:53:28,713 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/3ace8d8a79354779ab6173a69e6a1942 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/3ace8d8a79354779ab6173a69e6a1942 2023-03-19 14:53:28,720 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/3ace8d8a79354779ab6173a69e6a1942, entries=1, sequenceid=29, filesize=4.9 K 2023-03-19 14:53:28,722 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35f669f3cf30647988751ec77768992f in 857ms, sequenceid=29, compaction requested=true 2023-03-19 14:53:28,722 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:28,722 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:28,722 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:28,722 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:28,722 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,722 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:53:28,722 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:53:28,723 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,723 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:28,724 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,724 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:28,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:28,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:53:28,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@638dfaea[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:28,726 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:28,726 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,726 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,727 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:28,727 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:53:28,727 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:28,727 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,727 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:28,727 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,727 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:53:28,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:28,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:28,728 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:28,728 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:53:28,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:28,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:28,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:28,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:28,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:28,731 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:53:28,731 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:28,731 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:28,731 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,731 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:28,732 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,732 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:28,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:28,732 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:28,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:28,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:28,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:28,733 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:28,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,734 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:28,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,736 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,736 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,736 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:28,736 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:28,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:53:28,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:28,736 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:28,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:28,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:28,736 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:28,737 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,737 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,737 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,737 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,737 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:28,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:28,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:28,737 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:28,838 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:28,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:28,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:28,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:28,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,847 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:28,847 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:28,847 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:53:28,848 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:28,848 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,848 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,849 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,849 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:28,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:28,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:28,849 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:28,849 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:28,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:28,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,850 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,850 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:53:28,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:28,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:53:28,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:28,853 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:53:28,854 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:28,854 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:28,854 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:28,854 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. started... 2023-03-19 14:53:28,854 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35f669f3cf30647988751ec77768992f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:29,275 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b8b6b59be9e74e47aa256410dc18e140 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b8b6b59be9e74e47aa256410dc18e140 2023-03-19 14:53:29,682 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/adf5be63eebd4d258374ccf7c3f0d852 2023-03-19 14:53:29,693 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/adf5be63eebd4d258374ccf7c3f0d852 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/adf5be63eebd4d258374ccf7c3f0d852 2023-03-19 14:53:29,700 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/adf5be63eebd4d258374ccf7c3f0d852, entries=1, sequenceid=33, filesize=4.9 K 2023-03-19 14:53:29,701 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35f669f3cf30647988751ec77768992f in 847ms, sequenceid=33, compaction requested=true 2023-03-19 14:53:29,701 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:29,701 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:29,702 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:29,702 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:29,702 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,702 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:53:29,702 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:53:29,703 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,703 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:29,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:29,703 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,703 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:29,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:29,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:29,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:29,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:53:29,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c07212f[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:29,705 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:29,705 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,710 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,710 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:29,710 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:53:29,710 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:29,710 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,710 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:29,711 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:29,711 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:53:29,711 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:29,711 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:53:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:29,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:29,714 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:53:29,714 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:29,714 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:29,714 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,714 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:29,715 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,715 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:29,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:29,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,715 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:29,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:29,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:29,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:29,716 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:29,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,716 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:29,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,718 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,718 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:29,718 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:29,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:29,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:29,718 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:29,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:53:29,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:29,718 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:29,718 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,719 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,719 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,719 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,719 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:29,719 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:29,719 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:29,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:29,819 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:29,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:29,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:29,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:29,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,830 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:29,830 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:29,831 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:53:29,831 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:29,832 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,832 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,833 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:29,833 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:29,834 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:29,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,834 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:29,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,835 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,836 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:53:29,836 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:29,836 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:53:29,836 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:29,837 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:53:29,837 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:29,837 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:29,837 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:29,837 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. started... 2023-03-19 14:53:29,837 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35f669f3cf30647988751ec77768992f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:30,262 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090737b9278f5c3549a4bba85352a38c727e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090737b9278f5c3549a4bba85352a38c727e 2023-03-19 14:53:30,669 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/15387050e22e412b9846a4f638db2ed6 2023-03-19 14:53:30,682 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/15387050e22e412b9846a4f638db2ed6 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/15387050e22e412b9846a4f638db2ed6 2023-03-19 14:53:30,691 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/15387050e22e412b9846a4f638db2ed6, entries=1, sequenceid=37, filesize=4.9 K 2023-03-19 14:53:30,693 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35f669f3cf30647988751ec77768992f in 856ms, sequenceid=37, compaction requested=true 2023-03-19 14:53:30,693 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:30,693 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:30,693 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:30,693 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:30,693 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,693 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:53:30,693 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:53:30,695 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,695 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:30,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:30,695 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,695 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:30,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:30,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:30,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:30,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:53:30,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30fcb042[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:30,697 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:30,697 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,698 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,699 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:30,699 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:53:30,699 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:30,699 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,699 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:30,700 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:53:30,700 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,700 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:30,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:30,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:30,700 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:53:30,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:30,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:30,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:30,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:30,704 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:53:30,704 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:30,704 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:30,704 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,704 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:30,712 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,712 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:30,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,712 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:30,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:30,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:30,713 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:30,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:30,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,715 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,720 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,720 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:30,720 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:30,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:30,720 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:53:30,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:30,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:30,720 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:30,720 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:30,721 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:30,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:30,721 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:30,721 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,722 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:30,722 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,722 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,822 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:30,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:30,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:30,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:30,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,837 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:30,837 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:30,837 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:53:30,837 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:30,838 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,838 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,839 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:30,839 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:30,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:30,840 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:30,840 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:30,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,841 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,842 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:53:30,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:30,842 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:53:30,842 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:30,844 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:53:30,844 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:30,844 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:30,844 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:30,844 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. started... 2023-03-19 14:53:30,844 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 35f669f3cf30647988751ec77768992f 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:31,266 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112047824c81f51f4c8f882d7bf2983b644c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112047824c81f51f4c8f882d7bf2983b644c 2023-03-19 14:53:31,673 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/a3aa86ca53f34a7cbaa3c35b88c509ba 2023-03-19 14:53:31,684 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/a3aa86ca53f34a7cbaa3c35b88c509ba as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/a3aa86ca53f34a7cbaa3c35b88c509ba 2023-03-19 14:53:31,690 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/a3aa86ca53f34a7cbaa3c35b88c509ba, entries=1, sequenceid=41, filesize=4.9 K 2023-03-19 14:53:31,691 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 35f669f3cf30647988751ec77768992f in 847ms, sequenceid=41, compaction requested=true 2023-03-19 14:53:31,691 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:31,691 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:31,691 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:31,691 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:31,691 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,691 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:53:31,691 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:53:31,692 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,692 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:31,693 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,693 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:31,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:53:31,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dc7cb5f[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:31,694 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:31,694 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,695 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,695 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:31,695 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:53:31,695 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:31,695 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,695 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:31,696 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,696 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:53:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:31,696 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:31,696 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:53:31,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:31,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:31,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:31,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:31,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:31,699 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:53:31,699 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:31,699 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:31,699 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,699 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:31,700 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,700 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:31,700 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:31,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:31,700 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,701 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:31,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,702 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,702 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,702 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,702 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:31,703 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:31,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:53:31,703 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:31,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-19 14:53:31,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:31,703 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:31,704 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:31,704 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,704 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,704 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:31,704 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:31,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:31,804 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:31,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:31,807 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-19 14:53:31,810 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:53:31,811 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:53:31,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:53:31,813 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238211812 2023-03-19 14:53:31,814 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:53:31,816 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-19 14:53:31,816 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:53:31,817 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x3138e2bb to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:53:31,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@329afcca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:53:31,821 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:53:32,661 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031198709faaea4ed095882b14a675bc41 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601031198709faaea4ed095882b14a675bc41 2023-03-19 14:53:32,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:53:32,677 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:53:32,678 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43256, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:53:32,685 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:53:32,686 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42860, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:53:32,696 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/379ba8e6fec3425b9a404895c8bd5d8c first=Optional[r5] last=Optional[r6] 2023-03-19 14:53:32,697 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/379ba8e6fec3425b9a404895c8bd5d8c}] 2023-03-19 14:53:32,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/379ba8e6fec3425b9a404895c8bd5d8c for inclusion in 35f669f3cf30647988751ec77768992f/family1 2023-03-19 14:53:32,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-19 14:53:32,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:53:32,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:32,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/379ba8e6fec3425b9a404895c8bd5d8c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__91ee9oe4colteb5kpq5k2u53qo1q9o96q1nijjcootrg2tuoml7e8nlibkmks3f6/family1/379ba8e6fec3425b9a404895c8bd5d8c 2023-03-19 14:53:32,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__91ee9oe4colteb5kpq5k2u53qo1q9o96q1nijjcootrg2tuoml7e8nlibkmks3f6/family1/379ba8e6fec3425b9a404895c8bd5d8c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ec6372e1ab314c9ea067d528bf9876c9_SeqId_44_ 2023-03-19 14:53:32,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__91ee9oe4colteb5kpq5k2u53qo1q9o96q1nijjcootrg2tuoml7e8nlibkmks3f6/family1/379ba8e6fec3425b9a404895c8bd5d8c into 35f669f3cf30647988751ec77768992f/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ec6372e1ab314c9ea067d528bf9876c9_SeqId_44_ - updating store file list. 2023-03-19 14:53:32,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ec6372e1ab314c9ea067d528bf9876c9_SeqId_44_ into 35f669f3cf30647988751ec77768992f/family1 2023-03-19 14:53:32,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__91ee9oe4colteb5kpq5k2u53qo1q9o96q1nijjcootrg2tuoml7e8nlibkmks3f6/family1/379ba8e6fec3425b9a404895c8bd5d8c into 35f669f3cf30647988751ec77768992f/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ec6372e1ab314c9ea067d528bf9876c9_SeqId_44_) 2023-03-19 14:53:32,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__91ee9oe4colteb5kpq5k2u53qo1q9o96q1nijjcootrg2tuoml7e8nlibkmks3f6/family1/379ba8e6fec3425b9a404895c8bd5d8c 2023-03-19 14:53:32,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-19 14:53:32,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-19 14:53:32,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 35f669f3cf30647988751ec77768992f/family1 is initiating minor compaction 2023-03-19 14:53:32,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@84de891; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:32,720 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 35f669f3cf30647988751ec77768992f/family1 in testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:32,720 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/4ed31e99525140f1959814edc00c0d2a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/cc0d4371593e4a279707c4149acfced4, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fa4d7c9ef53d4611ac209dba8734ad0f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/b286e736ced04070837c5fa59953ea6f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/7e8b960cf51a4e71a09421ed170b5855, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/3ace8d8a79354779ab6173a69e6a1942, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/adf5be63eebd4d258374ccf7c3f0d852, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/15387050e22e412b9846a4f638db2ed6, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/a3aa86ca53f34a7cbaa3c35b88c509ba, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ec6372e1ab314c9ea067d528bf9876c9_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp, totalSize=49.7 K 2023-03-19 14:53:32,720 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 4ed31e99525140f1959814edc00c0d2a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-19 14:53:32,720 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting cc0d4371593e4a279707c4149acfced4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-19 14:53:32,720 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting fa4d7c9ef53d4611ac209dba8734ad0f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-19 14:53:32,721 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting b286e736ced04070837c5fa59953ea6f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-19 14:53:32,721 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 7e8b960cf51a4e71a09421ed170b5855, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-19 14:53:32,721 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 3ace8d8a79354779ab6173a69e6a1942, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-19 14:53:32,721 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting adf5be63eebd4d258374ccf7c3f0d852, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-19 14:53:32,721 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 15387050e22e412b9846a4f638db2ed6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-19 14:53:32,721 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting a3aa86ca53f34a7cbaa3c35b88c509ba, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-19 14:53:32,721 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting ec6372e1ab314c9ea067d528bf9876c9_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-19 14:53:32,722 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:53:32,723 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:32,725 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010153b9aa645a794af58889a5ea976c4651 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010153b9aa645a794af58889a5ea976c4651 2023-03-19 14:53:32,728 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b8b6b59be9e74e47aa256410dc18e140 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b8b6b59be9e74e47aa256410dc18e140 2023-03-19 14:53:32,728 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-19 14:53:32,729 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-19 14:53:32,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:53:32,729 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:53:32,764 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 35f669f3cf30647988751ec77768992f#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:53:33,190 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e603b1db503441f686b3cef29ea623f0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e603b1db503441f686b3cef29ea623f0 2023-03-19 14:53:33,191 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:53:33,215 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1da3498c0bb34c17aebfa8f8cbec2f75 first=Optional[r1] last=Optional[r4] 2023-03-19 14:53:33,216 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1da3498c0bb34c17aebfa8f8cbec2f75}] 2023-03-19 14:53:33,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1da3498c0bb34c17aebfa8f8cbec2f75 for inclusion in 35f669f3cf30647988751ec77768992f/family1 2023-03-19 14:53:33,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-19 14:53:33,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:53:33,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:33,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1da3498c0bb34c17aebfa8f8cbec2f75 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qr2vhnhvu6q15g606bv0rcace46n28m2c3fikcl59jjqs68s92immi24l9me2ope/family1/1da3498c0bb34c17aebfa8f8cbec2f75 2023-03-19 14:53:33,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qr2vhnhvu6q15g606bv0rcace46n28m2c3fikcl59jjqs68s92immi24l9me2ope/family1/1da3498c0bb34c17aebfa8f8cbec2f75 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ebf22ffec0e749f4be9eae610e2c46fa_SeqId_46_ 2023-03-19 14:53:33,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qr2vhnhvu6q15g606bv0rcace46n28m2c3fikcl59jjqs68s92immi24l9me2ope/family1/1da3498c0bb34c17aebfa8f8cbec2f75 into 35f669f3cf30647988751ec77768992f/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ebf22ffec0e749f4be9eae610e2c46fa_SeqId_46_ - updating store file list. 2023-03-19 14:53:33,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ebf22ffec0e749f4be9eae610e2c46fa_SeqId_46_ into 35f669f3cf30647988751ec77768992f/family1 2023-03-19 14:53:33,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qr2vhnhvu6q15g606bv0rcace46n28m2c3fikcl59jjqs68s92immi24l9me2ope/family1/1da3498c0bb34c17aebfa8f8cbec2f75 into 35f669f3cf30647988751ec77768992f/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ebf22ffec0e749f4be9eae610e2c46fa_SeqId_46_) 2023-03-19 14:53:33,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qr2vhnhvu6q15g606bv0rcace46n28m2c3fikcl59jjqs68s92immi24l9me2ope/family1/1da3498c0bb34c17aebfa8f8cbec2f75 2023-03-19 14:53:33,236 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:53:33,236 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:33,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ed4c615b6fcb451185898cb3318dc742 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ed4c615b6fcb451185898cb3318dc742 2023-03-19 14:53:33,239 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205667321d8887a4d79a3dae523c9925589 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205667321d8887a4d79a3dae523c9925589 2023-03-19 14:53:33,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122887c16508ba5b4996a57175bc7ecbffa5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122887c16508ba5b4996a57175bc7ecbffa5 2023-03-19 14:53:33,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123152cb1696f4fa4a0eb76f195c5eda975e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123152cb1696f4fa4a0eb76f195c5eda975e 2023-03-19 14:53:33,241 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-19 14:53:33,241 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-19 14:53:33,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:53:33,241 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:53:33,590 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/fcc65ad709564454931dc444657210c5 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fcc65ad709564454931dc444657210c5 2023-03-19 14:53:33,599 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 35f669f3cf30647988751ec77768992f/family1 of 35f669f3cf30647988751ec77768992f into fcc65ad709564454931dc444657210c5(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:53:33,599 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:33,599 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1679237612720; duration=0sec 2023-03-19 14:53:33,599 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:33,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/4ed31e99525140f1959814edc00c0d2a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/cc0d4371593e4a279707c4149acfced4, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fa4d7c9ef53d4611ac209dba8734ad0f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/b286e736ced04070837c5fa59953ea6f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/7e8b960cf51a4e71a09421ed170b5855, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/3ace8d8a79354779ab6173a69e6a1942, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/adf5be63eebd4d258374ccf7c3f0d852, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/15387050e22e412b9846a4f638db2ed6, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/a3aa86ca53f34a7cbaa3c35b88c509ba, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ec6372e1ab314c9ea067d528bf9876c9_SeqId_44_] to archive 2023-03-19 14:53:33,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:33,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/4ed31e99525140f1959814edc00c0d2a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/4ed31e99525140f1959814edc00c0d2a 2023-03-19 14:53:33,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/cc0d4371593e4a279707c4149acfced4 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/cc0d4371593e4a279707c4149acfced4 2023-03-19 14:53:33,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fa4d7c9ef53d4611ac209dba8734ad0f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fa4d7c9ef53d4611ac209dba8734ad0f 2023-03-19 14:53:33,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/b286e736ced04070837c5fa59953ea6f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/b286e736ced04070837c5fa59953ea6f 2023-03-19 14:53:33,691 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511302bc747d76f5942e4b310ef7b03976fe4 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511302bc747d76f5942e4b310ef7b03976fe4 2023-03-19 14:53:33,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:53:33,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/7e8b960cf51a4e71a09421ed170b5855 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/7e8b960cf51a4e71a09421ed170b5855 2023-03-19 14:53:33,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/3ace8d8a79354779ab6173a69e6a1942 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/3ace8d8a79354779ab6173a69e6a1942 2023-03-19 14:53:33,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/adf5be63eebd4d258374ccf7c3f0d852 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/adf5be63eebd4d258374ccf7c3f0d852 2023-03-19 14:53:33,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/15387050e22e412b9846a4f638db2ed6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/15387050e22e412b9846a4f638db2ed6 2023-03-19 14:53:33,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/a3aa86ca53f34a7cbaa3c35b88c509ba to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/a3aa86ca53f34a7cbaa3c35b88c509ba 2023-03-19 14:53:33,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ec6372e1ab314c9ea067d528bf9876c9_SeqId_44_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ec6372e1ab314c9ea067d528bf9876c9_SeqId_44_ 2023-03-19 14:53:33,716 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6168cd85e1314826979e256eb30431d2 first=Optional[r00] last=Optional[r8] 2023-03-19 14:53:33,717 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6168cd85e1314826979e256eb30431d2}] 2023-03-19 14:53:33,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6168cd85e1314826979e256eb30431d2 for inclusion in 35f669f3cf30647988751ec77768992f/family1 2023-03-19 14:53:33,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-19 14:53:33,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:53:33,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:33,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6168cd85e1314826979e256eb30431d2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nn6lutjtl82l84rns7s4qgue2c9576mb1olv5gms29qjhtgaq6l08bdhqfedrmi5/family1/6168cd85e1314826979e256eb30431d2 2023-03-19 14:53:33,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nn6lutjtl82l84rns7s4qgue2c9576mb1olv5gms29qjhtgaq6l08bdhqfedrmi5/family1/6168cd85e1314826979e256eb30431d2 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ac1cc320ef07479e8f89845ea918f366_SeqId_49_ 2023-03-19 14:53:33,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nn6lutjtl82l84rns7s4qgue2c9576mb1olv5gms29qjhtgaq6l08bdhqfedrmi5/family1/6168cd85e1314826979e256eb30431d2 into 35f669f3cf30647988751ec77768992f/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ac1cc320ef07479e8f89845ea918f366_SeqId_49_ - updating store file list. 2023-03-19 14:53:33,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ac1cc320ef07479e8f89845ea918f366_SeqId_49_ into 35f669f3cf30647988751ec77768992f/family1 2023-03-19 14:53:33,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nn6lutjtl82l84rns7s4qgue2c9576mb1olv5gms29qjhtgaq6l08bdhqfedrmi5/family1/6168cd85e1314826979e256eb30431d2 into 35f669f3cf30647988751ec77768992f/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ac1cc320ef07479e8f89845ea918f366_SeqId_49_) 2023-03-19 14:53:33,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nn6lutjtl82l84rns7s4qgue2c9576mb1olv5gms29qjhtgaq6l08bdhqfedrmi5/family1/6168cd85e1314826979e256eb30431d2 2023-03-19 14:53:33,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-19 14:53:33,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-19 14:53:33,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 35f669f3cf30647988751ec77768992f/family1 is initiating minor compaction (all files) 2023-03-19 14:53:33,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7f7daa7d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:33,737 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 35f669f3cf30647988751ec77768992f/family1 in testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:53:33,737 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/9b426796a44a475f9e46a73a58e9ea53, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fcc65ad709564454931dc444657210c5, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ebf22ffec0e749f4be9eae610e2c46fa_SeqId_46_, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ac1cc320ef07479e8f89845ea918f366_SeqId_49_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp, totalSize=344.3 K 2023-03-19 14:53:33,738 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 9b426796a44a475f9e46a73a58e9ea53, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878808483 2023-03-19 14:53:33,739 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting fcc65ad709564454931dc444657210c5, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621208483 2023-03-19 14:53:33,739 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting ebf22ffec0e749f4be9eae610e2c46fa_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965208483 2023-03-19 14:53:33,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:53:33,740 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting ac1cc320ef07479e8f89845ea918f366_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014808483 2023-03-19 14:53:33,740 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:33,742 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112047824c81f51f4c8f882d7bf2983b644c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112047824c81f51f4c8f882d7bf2983b644c 2023-03-19 14:53:33,744 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c014a2a71ef640f5bce91ceb3675c55f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c014a2a71ef640f5bce91ceb3675c55f 2023-03-19 14:53:33,745 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b30f464980ac4d9bbba1daa22179a251 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b30f464980ac4d9bbba1daa22179a251 2023-03-19 14:53:33,745 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-19 14:53:33,745 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-19 14:53:33,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:53:33,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:53:33,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:53:33,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:53:33,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:53:33,747 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:53:33,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.9390 sec 2023-03-19 14:53:33,767 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] throttle.PressureAwareThroughputController(145): 35f669f3cf30647988751ec77768992f#family1#compaction#23 average throughput is 11.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:53:33,841 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=260 (was 248) Potentially hanging thread: hconnection-0x7de0e0d8-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47098 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-170373635-148.251.75.209-1679237579633:blk_1073741900_1076, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47292 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56323@0x3138e2bb-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a6edd9870477440e9eeac13561cebdd0 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/2d8497a78a234907a22ec7989c0771fc block BP-170373635-148.251.75.209-1679237579633:blk_1073741900_1076 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47084 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47082 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1050568762_15 at /127.0.0.1:47164 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/cluster_f5186ab3-a777-2045-9287-c86a253161ea/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7de0e0d8-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47204 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47192 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ef00bf8-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47188 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/cluster_f5186ab3-a777-2045-9287-c86a253161ea/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7de0e0d8-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47210 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47286 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56323@0x3138e2bb sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1900094437.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7de0e0d8-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47180 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1050568762_15 at /127.0.0.1:47302 [Receiving block BP-170373635-148.251.75.209-1679237579633:blk_1073741900_1076] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47132 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47120 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7de0e0d8-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-170373635-148.251.75.209-1679237579633:blk_1073741900_1076 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47148 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56323@0x3138e2bb-SendThread(127.0.0.1:56323) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:36084 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1815153085_15 at /127.0.0.1:47062 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7de0e0d8-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7de0e0d8-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=612 (was 586) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=313 (was 306) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4545 (was 4564) 2023-03-19 14:53:33,852 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259, OpenFileDescriptor=612, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=168, AvailableMemoryMB=4545 2023-03-19 14:53:33,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-19 14:53:33,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:33,857 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:53:33,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-19 14:53:33,858 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:53:33,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-19 14:53:33,859 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1 2023-03-19 14:53:33,860 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1 empty. 2023-03-19 14:53:33,860 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1 2023-03-19 14:53:33,860 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-19 14:53:33,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-19 14:53:34,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-19 14:53:34,270 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-19 14:53:34,273 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 388c287f67c220514160956691cb71c1, NAME => 'testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:53:34,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-19 14:53:34,602 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/.tmp/family1/2d8497a78a234907a22ec7989c0771fc as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/2d8497a78a234907a22ec7989c0771fc 2023-03-19 14:53:34,607 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 35f669f3cf30647988751ec77768992f/family1 of 35f669f3cf30647988751ec77768992f into 2d8497a78a234907a22ec7989c0771fc(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:53:34,608 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:53:34,608 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1679237613737; duration=0sec 2023-03-19 14:53:34,608 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:34,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/9b426796a44a475f9e46a73a58e9ea53, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fcc65ad709564454931dc444657210c5, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ebf22ffec0e749f4be9eae610e2c46fa_SeqId_46_, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ac1cc320ef07479e8f89845ea918f366_SeqId_49_] to archive 2023-03-19 14:53:34,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:34,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/9b426796a44a475f9e46a73a58e9ea53 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/9b426796a44a475f9e46a73a58e9ea53 2023-03-19 14:53:34,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fcc65ad709564454931dc444657210c5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/fcc65ad709564454931dc444657210c5 2023-03-19 14:53:34,678 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ebf22ffec0e749f4be9eae610e2c46fa_SeqId_46_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ebf22ffec0e749f4be9eae610e2c46fa_SeqId_46_ 2023-03-19 14:53:34,680 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ac1cc320ef07479e8f89845ea918f366_SeqId_49_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/family1/ac1cc320ef07479e8f89845ea918f366_SeqId_49_ 2023-03-19 14:53:34,686 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:34,686 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 388c287f67c220514160956691cb71c1, disabling compactions & flushes 2023-03-19 14:53:34,686 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:34,687 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:34,687 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. after waiting 0 ms 2023-03-19 14:53:34,687 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:34,687 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:34,687 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:34,690 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:53:34,691 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679237614691"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237614691"}]},"ts":"1679237614691"} 2023-03-19 14:53:34,693 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-19 14:53:34,694 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:53:34,695 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237614695"}]},"ts":"1679237614695"} 2023-03-19 14:53:34,697 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-19 14:53:34,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=388c287f67c220514160956691cb71c1, ASSIGN}] 2023-03-19 14:53:34,702 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=388c287f67c220514160956691cb71c1, ASSIGN 2023-03-19 14:53:34,703 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=388c287f67c220514160956691cb71c1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:53:34,855 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=388c287f67c220514160956691cb71c1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:34,855 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679237614855"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237614855"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237614855"}]},"ts":"1679237614855"} 2023-03-19 14:53:34,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 388c287f67c220514160956691cb71c1, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:34,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-19 14:53:35,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:35,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 388c287f67c220514160956691cb71c1, NAME => 'testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:53:35,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 388c287f67c220514160956691cb71c1 2023-03-19 14:53:35,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:35,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 388c287f67c220514160956691cb71c1 2023-03-19 14:53:35,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 388c287f67c220514160956691cb71c1 2023-03-19 14:53:35,024 INFO [StoreOpener-388c287f67c220514160956691cb71c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 388c287f67c220514160956691cb71c1 2023-03-19 14:53:35,028 DEBUG [StoreOpener-388c287f67c220514160956691cb71c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1 2023-03-19 14:53:35,028 DEBUG [StoreOpener-388c287f67c220514160956691cb71c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1 2023-03-19 14:53:35,028 INFO [StoreOpener-388c287f67c220514160956691cb71c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 388c287f67c220514160956691cb71c1 columnFamilyName family1 2023-03-19 14:53:35,031 INFO [StoreOpener-388c287f67c220514160956691cb71c1-1] regionserver.HStore(310): Store=388c287f67c220514160956691cb71c1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:35,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1 2023-03-19 14:53:35,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1 2023-03-19 14:53:35,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 388c287f67c220514160956691cb71c1 2023-03-19 14:53:35,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:53:35,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 388c287f67c220514160956691cb71c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68378916, jitterRate=0.018925249576568604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:53:35,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:35,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1., pid=25, masterSystemTime=1679237615013 2023-03-19 14:53:35,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:35,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:35,044 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=388c287f67c220514160956691cb71c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:35,044 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679237615044"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237615044"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237615044"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237615044"}]},"ts":"1679237615044"} 2023-03-19 14:53:35,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-19 14:53:35,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 388c287f67c220514160956691cb71c1, server=jenkins-hbase20.apache.org,33191,1679237584457 in 187 msec 2023-03-19 14:53:35,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-19 14:53:35,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=388c287f67c220514160956691cb71c1, ASSIGN in 347 msec 2023-03-19 14:53:35,051 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:53:35,051 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237615051"}]},"ts":"1679237615051"} 2023-03-19 14:53:35,052 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-19 14:53:35,055 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:53:35,056 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.2010 sec 2023-03-19 14:53:35,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-19 14:53:35,969 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-19 14:53:36,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:36,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,007 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:36,007 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:36,007 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:36,007 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:36,008 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,008 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,009 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,009 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:36,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:36,009 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,009 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:36,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,010 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,010 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:36,010 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:36,010 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:36,010 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:36,010 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:36,010 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:36,010 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. started... 2023-03-19 14:53:36,011 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 388c287f67c220514160956691cb71c1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-19 14:53:36,344 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:36,447 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113093f2039a79364b7ba1536bf790f5e53f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113093f2039a79364b7ba1536bf790f5e53f 2023-03-19 14:53:36,452 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/375bf25b5ba146798098938bca8a8cb7 2023-03-19 14:53:36,457 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/375bf25b5ba146798098938bca8a8cb7 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/375bf25b5ba146798098938bca8a8cb7 2023-03-19 14:53:36,462 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/375bf25b5ba146798098938bca8a8cb7, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-19 14:53:36,463 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 388c287f67c220514160956691cb71c1 in 451ms, sequenceid=5, compaction requested=false 2023-03-19 14:53:36,463 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:36,463 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:36,463 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:36,463 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:36,463 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,463 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:36,464 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:36,465 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,465 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:36,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:36,465 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,465 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:36,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:36,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:36,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:36,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:36,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@611136a7[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:36,467 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:36,467 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,467 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,468 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:36,468 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:36,468 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:36,468 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,468 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:36,468 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,468 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:36,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:36,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:36,468 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:36,469 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:36,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:36,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:36,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:36,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:36,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:36,471 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:36,471 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:36,471 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:36,471 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,471 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:36,472 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,472 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:36,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:36,472 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:36,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:36,473 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:36,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:36,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:36,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,474 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:36,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,476 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,476 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:36,476 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:36,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:36,476 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:36,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:36,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:36,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:36,476 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:36,476 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:36,476 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:36,477 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:36,476 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,477 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:36,477 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,477 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,577 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:36,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:36,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:36,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:36,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,592 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:36,592 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:36,592 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:36,592 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:36,593 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,593 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,594 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,594 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:36,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:36,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:36,595 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:36,595 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:36,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:36,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,596 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,596 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:36,597 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:36,597 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:36,597 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:36,597 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:36,597 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:36,597 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:36,597 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:36,597 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. started... 2023-03-19 14:53:36,597 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 388c287f67c220514160956691cb71c1 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-19 14:53:37,019 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283a497aa945644524a10d8f9dda58835f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511283a497aa945644524a10d8f9dda58835f 2023-03-19 14:53:37,428 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/717765a989a24369bc2230946dd134a3 2023-03-19 14:53:37,442 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/717765a989a24369bc2230946dd134a3 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/717765a989a24369bc2230946dd134a3 2023-03-19 14:53:37,449 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/717765a989a24369bc2230946dd134a3, entries=1, sequenceid=9, filesize=5.0 K 2023-03-19 14:53:37,450 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 388c287f67c220514160956691cb71c1 in 853ms, sequenceid=9, compaction requested=false 2023-03-19 14:53:37,450 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:37,450 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:37,450 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:37,451 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:37,451 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,451 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:37,451 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:37,508 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,508 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:37,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:37,509 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:37,510 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:37,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:37,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:37,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:37,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44ba7df3[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:37,515 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:37,515 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,516 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,517 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:37,517 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:37,517 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:37,517 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,517 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:37,519 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:37,519 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,519 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:37,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:37,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:37,519 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:37,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:37,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:37,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:37,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:37,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:37,525 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:37,525 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:37,525 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:37,525 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,525 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:37,528 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,528 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:37,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:37,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,528 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:37,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:37,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:37,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:37,529 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:37,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,531 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:37,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,534 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,534 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:37,534 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:37,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:37,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:37,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:37,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:37,535 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,535 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:37,535 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:37,535 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,535 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:37,536 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:37,536 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:37,536 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:37,536 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,636 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:37,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:37,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:37,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:37,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,652 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:37,652 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:37,652 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:37,652 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:37,653 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,653 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,654 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:37,654 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:37,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:37,654 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:37,654 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:37,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:37,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,655 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,656 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:37,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:37,656 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:37,656 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:37,656 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:37,656 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:37,656 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:37,656 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:37,656 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. started... 2023-03-19 14:53:37,656 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 388c287f67c220514160956691cb71c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:38,081 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015f3e40dfc3b7401e9d32e883dcd8b0e7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512015f3e40dfc3b7401e9d32e883dcd8b0e7 2023-03-19 14:53:38,087 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/647c517f123f4101bce0963254a6ff06 2023-03-19 14:53:38,093 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/647c517f123f4101bce0963254a6ff06 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/647c517f123f4101bce0963254a6ff06 2023-03-19 14:53:38,098 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/647c517f123f4101bce0963254a6ff06, entries=1, sequenceid=13, filesize=4.9 K 2023-03-19 14:53:38,099 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 388c287f67c220514160956691cb71c1 in 443ms, sequenceid=13, compaction requested=true 2023-03-19 14:53:38,099 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:38,100 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:38,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:38,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:38,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:38,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:38,101 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,101 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:38,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:38,101 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,101 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:38,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:38,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:38,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:38,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:38,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1111ab86[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:38,103 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:38,103 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,104 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,104 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:38,104 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:38,104 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:38,104 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,104 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:38,105 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:38,105 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,105 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:38,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:38,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:38,105 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:38,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:38,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:38,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:38,107 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:38,107 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:38,107 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:38,107 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,107 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:38,108 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,108 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:38,108 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:38,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:38,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,109 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:38,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:38,109 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:38,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:38,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:38,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:38,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:38,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:38,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:38,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,112 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:38,113 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:38,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:38,113 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:38,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:38,213 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:38,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:38,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:38,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:38,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,228 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:38,228 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:38,229 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:38,229 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:38,229 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,229 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,231 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,231 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:38,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:38,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:38,231 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:38,231 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:38,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:38,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,233 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,234 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:38,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:38,234 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:38,234 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:38,234 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:38,234 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:38,234 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:38,234 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:38,234 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. started... 2023-03-19 14:53:38,234 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 388c287f67c220514160956691cb71c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:38,661 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d4b856eeb08548689fc47b02ea893fbc to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205d4b856eeb08548689fc47b02ea893fbc 2023-03-19 14:53:39,070 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/1bea75e8bd9d4ddf8c1f390abd042ff0 2023-03-19 14:53:39,082 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/1bea75e8bd9d4ddf8c1f390abd042ff0 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/1bea75e8bd9d4ddf8c1f390abd042ff0 2023-03-19 14:53:39,090 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/1bea75e8bd9d4ddf8c1f390abd042ff0, entries=1, sequenceid=17, filesize=4.9 K 2023-03-19 14:53:39,091 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 388c287f67c220514160956691cb71c1 in 857ms, sequenceid=17, compaction requested=true 2023-03-19 14:53:39,091 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:39,091 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:39,091 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:39,092 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:39,092 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,092 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:39,092 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:39,093 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,093 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:39,094 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,094 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:39,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:39,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42df17c8[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:39,097 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:39,097 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,098 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,098 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:39,098 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:39,098 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:39,098 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,098 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:39,099 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,099 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:39,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:39,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:39,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:39,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:39,103 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:39,103 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:39,103 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:39,103 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,103 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:39,105 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,105 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:39,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,105 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:39,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:39,106 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:39,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,108 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,111 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,111 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,111 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:39,111 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:39,111 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:39,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:39,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:39,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:39,111 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:39,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:39,111 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,112 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:39,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:39,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:39,112 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:39,112 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,213 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:39,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:39,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:39,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:39,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,228 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:39,228 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:39,228 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:39,228 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:39,229 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,229 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,230 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:39,230 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:39,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:39,230 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:39,230 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:39,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,231 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,231 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:39,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:39,231 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:39,231 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:39,231 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:39,231 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:39,231 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:39,231 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:39,231 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. started... 2023-03-19 14:53:39,232 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 388c287f67c220514160956691cb71c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:39,645 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228eb3eef98cde44ce2be8cb9104c8de667 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228eb3eef98cde44ce2be8cb9104c8de667 2023-03-19 14:53:40,051 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/febdc623fe30494eb0a7972dfbf52fa7 2023-03-19 14:53:40,057 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/febdc623fe30494eb0a7972dfbf52fa7 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/febdc623fe30494eb0a7972dfbf52fa7 2023-03-19 14:53:40,062 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/febdc623fe30494eb0a7972dfbf52fa7, entries=1, sequenceid=21, filesize=4.9 K 2023-03-19 14:53:40,063 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 388c287f67c220514160956691cb71c1 in 831ms, sequenceid=21, compaction requested=true 2023-03-19 14:53:40,063 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:40,063 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:40,063 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:40,063 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:40,063 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,063 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:40,063 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:40,064 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,064 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:40,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:40,065 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,065 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:40,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:40,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:40,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:40,066 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:40,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a13a53a[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:40,066 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,067 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,067 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:40,067 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:40,067 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,067 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:40,067 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:40,068 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,068 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:40,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:40,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:40,068 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:40,069 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:40,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:40,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:40,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:40,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:40,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:40,071 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:40,071 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:40,072 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:40,072 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,072 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:40,073 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,073 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:40,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,073 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:40,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:40,073 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:40,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:40,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:40,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,074 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:40,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,076 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:40,076 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:40,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:40,076 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:40,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:40,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:40,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:40,077 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:40,077 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,077 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,077 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:40,077 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,077 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:40,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:40,077 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:40,077 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,077 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,177 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:40,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:40,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:40,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:40,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,192 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:40,192 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:40,192 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:40,192 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:40,192 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,193 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,194 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:40,194 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:40,194 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:40,194 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:40,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,196 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,196 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:40,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:40,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:40,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:40,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:40,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:40,197 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:40,197 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:40,197 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. started... 2023-03-19 14:53:40,197 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 388c287f67c220514160956691cb71c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:40,551 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:53:40,617 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e5c0ebd14ef9432cb5055492f1a850f9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e5c0ebd14ef9432cb5055492f1a850f9 2023-03-19 14:53:41,025 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/f23a124022ad4d4881fd8cd197c6412c 2023-03-19 14:53:41,038 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/f23a124022ad4d4881fd8cd197c6412c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/f23a124022ad4d4881fd8cd197c6412c 2023-03-19 14:53:41,046 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/f23a124022ad4d4881fd8cd197c6412c, entries=1, sequenceid=25, filesize=4.9 K 2023-03-19 14:53:41,047 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 388c287f67c220514160956691cb71c1 in 850ms, sequenceid=25, compaction requested=true 2023-03-19 14:53:41,047 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:41,047 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:41,047 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:41,047 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:41,047 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,047 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:41,047 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:41,049 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,049 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:41,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:41,049 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,049 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:41,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:41,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:41,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:41,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:41,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dd1006e[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:41,052 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:41,052 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,053 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,053 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:41,053 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:41,053 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:41,053 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,053 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:41,056 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,056 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:41,056 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:41,056 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:41,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:41,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:41,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:41,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:41,059 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:41,059 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:41,059 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:41,059 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,059 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:41,061 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,061 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:41,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,061 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,062 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:41,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:41,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,063 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:41,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,065 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:41,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:41,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:41,065 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:41,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:41,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:41,166 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:41,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:41,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,183 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:41,183 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:41,183 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:41,183 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:41,184 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,184 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,185 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,185 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:41,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:41,186 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:41,186 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,188 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,188 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:41,188 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:41,189 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:41,189 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:41,192 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:41,192 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:41,192 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:41,192 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. started... 2023-03-19 14:53:41,192 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 388c287f67c220514160956691cb71c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:41,615 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017b3d941087a147aa92d4b61f57dfa2bb to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601017b3d941087a147aa92d4b61f57dfa2bb 2023-03-19 14:53:42,024 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/b0074ee5b8ac4bfd8b8b3560da9bf4e7 2023-03-19 14:53:42,037 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/b0074ee5b8ac4bfd8b8b3560da9bf4e7 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b0074ee5b8ac4bfd8b8b3560da9bf4e7 2023-03-19 14:53:42,041 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b0074ee5b8ac4bfd8b8b3560da9bf4e7, entries=1, sequenceid=29, filesize=4.9 K 2023-03-19 14:53:42,042 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 388c287f67c220514160956691cb71c1 in 850ms, sequenceid=29, compaction requested=true 2023-03-19 14:53:42,042 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:42,042 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:42,043 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:42,043 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:42,043 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,043 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:42,043 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:42,044 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,044 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:42,044 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,044 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:42,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:42,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2180d1c9[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:42,045 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:42,045 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,046 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,046 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:42,046 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:42,046 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:42,046 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,046 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:42,047 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,047 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:42,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:42,047 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:42,048 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:42,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:42,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:42,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:42,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:42,050 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:42,050 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:42,050 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:42,050 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,050 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:42,051 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,051 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:42,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,051 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:42,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:42,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:42,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:42,052 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:42,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:42,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,053 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:42,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,054 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,054 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,054 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:42,054 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:42,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:42,055 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:42,055 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:42,055 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:42,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:42,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:42,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:42,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:42,055 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,055 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,055 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,055 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:42,055 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:42,155 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:42,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:42,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:42,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:42,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,170 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:42,170 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:42,170 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:42,170 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:42,171 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,171 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,172 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,172 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:42,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:42,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:42,172 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,172 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:42,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,173 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,173 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:42,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,173 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:42,173 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:42,173 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:42,173 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:42,173 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:42,173 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:42,173 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. started... 2023-03-19 14:53:42,173 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 388c287f67c220514160956691cb71c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:42,586 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037d070a76ebc4498c893f80f0ecc83e92 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601037d070a76ebc4498c893f80f0ecc83e92 2023-03-19 14:53:42,592 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/d1d9699ee84a44ba81cccc5342cdd400 2023-03-19 14:53:42,599 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/d1d9699ee84a44ba81cccc5342cdd400 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d1d9699ee84a44ba81cccc5342cdd400 2023-03-19 14:53:42,605 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d1d9699ee84a44ba81cccc5342cdd400, entries=1, sequenceid=33, filesize=4.9 K 2023-03-19 14:53:42,606 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 388c287f67c220514160956691cb71c1 in 433ms, sequenceid=33, compaction requested=true 2023-03-19 14:53:42,606 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:42,606 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:42,607 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:42,607 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:42,607 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,607 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:42,607 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:42,608 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,608 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:42,609 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,609 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:42,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:42,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:42,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bdbe366[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:42,611 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:42,611 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,612 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,612 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:42,612 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:42,612 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:42,612 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,613 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:42,614 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,614 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:42,614 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:42,614 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:42,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:42,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:42,617 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:42,617 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:42,617 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:42,617 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,617 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:42,628 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,628 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:42,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,628 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:42,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:42,628 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,629 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:42,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,636 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:42,636 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:42,636 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:42,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:42,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:42,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:42,636 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:42,636 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:42,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:42,637 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,637 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:42,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:42,637 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:42,637 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,637 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,637 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,637 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,737 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:42,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:42,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:42,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:42,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,744 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:42,744 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:42,744 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:42,744 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:42,744 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,744 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,745 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:42,745 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:42,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:42,745 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:42,746 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:42,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:42,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,746 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,746 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:42,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:42,747 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:42,747 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:42,747 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:42,747 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:42,747 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:42,747 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:42,747 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. started... 2023-03-19 14:53:42,747 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 388c287f67c220514160956691cb71c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:43,167 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b5ecbe547a16406896b158921a5d88ff to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907b5ecbe547a16406896b158921a5d88ff 2023-03-19 14:53:43,174 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/627a8e59a7db43f8b94bdb3fe37829d4 2023-03-19 14:53:43,181 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/627a8e59a7db43f8b94bdb3fe37829d4 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/627a8e59a7db43f8b94bdb3fe37829d4 2023-03-19 14:53:43,186 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/627a8e59a7db43f8b94bdb3fe37829d4, entries=1, sequenceid=37, filesize=4.9 K 2023-03-19 14:53:43,186 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 388c287f67c220514160956691cb71c1 in 439ms, sequenceid=37, compaction requested=true 2023-03-19 14:53:43,187 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:43,187 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:43,187 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:43,187 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:43,187 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,187 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:43,187 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:43,188 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,188 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:43,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:43,188 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,188 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:43,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:43,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:43,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:43,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:43,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cd6af52[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:43,190 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:43,190 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,191 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,192 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:43,192 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:43,192 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:43,192 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,192 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:43,193 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,193 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:43,193 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:43,193 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:43,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:43,195 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:43,195 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:43,195 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:43,195 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,195 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:43,196 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,196 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,196 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:43,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:43,196 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:43,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,197 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:43,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,198 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,199 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,199 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:43,199 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:43,199 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:43,199 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:43,199 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,199 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,199 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,199 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:43,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:43,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:43,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:43,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:43,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:43,199 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:43,199 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:43,299 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:43,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:43,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:43,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:43,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,311 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:43,312 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:43,312 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:43,312 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:43,312 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,312 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,314 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:43,314 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:43,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:43,314 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:43,314 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:43,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,315 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:43,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:43,316 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:43,316 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:43,316 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:43,316 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:43,316 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:43,316 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:43,316 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. started... 2023-03-19 14:53:43,316 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 388c287f67c220514160956691cb71c1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:43,737 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207244392cf0244c74a62bc9da2e3f3a99 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511207244392cf0244c74a62bc9da2e3f3a99 2023-03-19 14:53:44,148 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/b37a7d1565ca459799c0645003c84330 2023-03-19 14:53:44,160 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/b37a7d1565ca459799c0645003c84330 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b37a7d1565ca459799c0645003c84330 2023-03-19 14:53:44,166 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b37a7d1565ca459799c0645003c84330, entries=1, sequenceid=41, filesize=4.9 K 2023-03-19 14:53:44,167 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 388c287f67c220514160956691cb71c1 in 851ms, sequenceid=41, compaction requested=true 2023-03-19 14:53:44,167 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:44,168 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:44,168 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:44,168 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:44,168 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,168 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:44,168 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:44,169 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,169 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:44,169 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,169 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:44,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:44,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19b108d6[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:44,171 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:44,171 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,171 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,171 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:44,172 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,172 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:44,172 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:44,172 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:44,172 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,172 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:44,172 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:44,173 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:44,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:44,174 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:44,174 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:44,174 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:44,174 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,174 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:44,175 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,175 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:44,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:44,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,175 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:44,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,176 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:44,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,177 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,178 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,178 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,178 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:44,178 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:44,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-19 14:53:44,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:44,178 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:44,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:44,178 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:44,178 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:44,178 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:44,178 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,179 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:44,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:44,179 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,179 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,279 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:44,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:44,282 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-19 14:53:44,286 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:53:44,287 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:53:44,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:53:44,289 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238224289 2023-03-19 14:53:44,290 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-19 14:53:44,292 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-19 14:53:44,292 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:53:44,292 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x39c7bf3b to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:53:44,295 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c5e6865, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:53:44,296 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:53:45,145 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036df56573d14d43c792a8c7b86041b48a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601036df56573d14d43c792a8c7b86041b48a 2023-03-19 14:53:45,147 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:53:45,160 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:53:45,161 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36710, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:53:45,167 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:53:45,169 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56722, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:53:45,179 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a9ef824a7018475fa7c005485745685d first=Optional[r3] last=Optional[r6] 2023-03-19 14:53:45,180 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a9ef824a7018475fa7c005485745685d}] 2023-03-19 14:53:45,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a9ef824a7018475fa7c005485745685d for inclusion in 388c287f67c220514160956691cb71c1/family1 2023-03-19 14:53:45,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-19 14:53:45,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:53:45,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:45,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a9ef824a7018475fa7c005485745685d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__i0kdjigst6f8fun3gr93ckkb11sljig6b4c6idhqef77821g252g1ebpikjr911o/family1/a9ef824a7018475fa7c005485745685d 2023-03-19 14:53:45,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__i0kdjigst6f8fun3gr93ckkb11sljig6b4c6idhqef77821g252g1ebpikjr911o/family1/a9ef824a7018475fa7c005485745685d as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/72a24b07267c4ab5ae9d918b29defc27_SeqId_44_ 2023-03-19 14:53:45,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__i0kdjigst6f8fun3gr93ckkb11sljig6b4c6idhqef77821g252g1ebpikjr911o/family1/a9ef824a7018475fa7c005485745685d into 388c287f67c220514160956691cb71c1/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/72a24b07267c4ab5ae9d918b29defc27_SeqId_44_ - updating store file list. 2023-03-19 14:53:45,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/72a24b07267c4ab5ae9d918b29defc27_SeqId_44_ into 388c287f67c220514160956691cb71c1/family1 2023-03-19 14:53:45,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__i0kdjigst6f8fun3gr93ckkb11sljig6b4c6idhqef77821g252g1ebpikjr911o/family1/a9ef824a7018475fa7c005485745685d into 388c287f67c220514160956691cb71c1/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/72a24b07267c4ab5ae9d918b29defc27_SeqId_44_) 2023-03-19 14:53:45,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__i0kdjigst6f8fun3gr93ckkb11sljig6b4c6idhqef77821g252g1ebpikjr911o/family1/a9ef824a7018475fa7c005485745685d 2023-03-19 14:53:45,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-19 14:53:45,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-19 14:53:45,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 388c287f67c220514160956691cb71c1/family1 is initiating minor compaction 2023-03-19 14:53:45,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@965aa21; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:45,201 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 388c287f67c220514160956691cb71c1/family1 in testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:45,201 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/717765a989a24369bc2230946dd134a3, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/647c517f123f4101bce0963254a6ff06, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/1bea75e8bd9d4ddf8c1f390abd042ff0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/febdc623fe30494eb0a7972dfbf52fa7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/f23a124022ad4d4881fd8cd197c6412c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b0074ee5b8ac4bfd8b8b3560da9bf4e7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d1d9699ee84a44ba81cccc5342cdd400, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/627a8e59a7db43f8b94bdb3fe37829d4, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b37a7d1565ca459799c0645003c84330, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/72a24b07267c4ab5ae9d918b29defc27_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp, totalSize=50.0 K 2023-03-19 14:53:45,202 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 717765a989a24369bc2230946dd134a3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-19 14:53:45,202 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 647c517f123f4101bce0963254a6ff06, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-19 14:53:45,202 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 1bea75e8bd9d4ddf8c1f390abd042ff0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-19 14:53:45,202 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting febdc623fe30494eb0a7972dfbf52fa7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-19 14:53:45,202 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting f23a124022ad4d4881fd8cd197c6412c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-19 14:53:45,202 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting b0074ee5b8ac4bfd8b8b3560da9bf4e7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-19 14:53:45,202 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting d1d9699ee84a44ba81cccc5342cdd400, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-19 14:53:45,202 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 627a8e59a7db43f8b94bdb3fe37829d4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-19 14:53:45,202 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting b37a7d1565ca459799c0645003c84330, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-19 14:53:45,202 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 72a24b07267c4ab5ae9d918b29defc27_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-19 14:53:45,203 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:53:45,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:45,206 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228eb3eef98cde44ce2be8cb9104c8de667 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228eb3eef98cde44ce2be8cb9104c8de667 2023-03-19 14:53:45,207 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e5c0ebd14ef9432cb5055492f1a850f9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e5c0ebd14ef9432cb5055492f1a850f9 2023-03-19 14:53:45,209 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601017b3d941087a147aa92d4b61f57dfa2bb to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601017b3d941087a147aa92d4b61f57dfa2bb 2023-03-19 14:53:45,210 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601037d070a76ebc4498c893f80f0ecc83e92 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601037d070a76ebc4498c893f80f0ecc83e92 2023-03-19 14:53:45,210 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-19 14:53:45,210 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-19 14:53:45,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:53:45,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:53:45,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:53:45,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:53:45,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:53:45,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:53:45,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:53:45,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:53:45,232 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 388c287f67c220514160956691cb71c1#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:53:45,650 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/d679a43a638045b6ba050190213713a9 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d679a43a638045b6ba050190213713a9 2023-03-19 14:53:45,657 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 388c287f67c220514160956691cb71c1/family1 of 388c287f67c220514160956691cb71c1 into d679a43a638045b6ba050190213713a9(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:53:45,657 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:45,658 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1679237625201; duration=0sec 2023-03-19 14:53:45,658 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:45,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/717765a989a24369bc2230946dd134a3, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/647c517f123f4101bce0963254a6ff06, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/1bea75e8bd9d4ddf8c1f390abd042ff0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/febdc623fe30494eb0a7972dfbf52fa7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/f23a124022ad4d4881fd8cd197c6412c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b0074ee5b8ac4bfd8b8b3560da9bf4e7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d1d9699ee84a44ba81cccc5342cdd400, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/627a8e59a7db43f8b94bdb3fe37829d4, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b37a7d1565ca459799c0645003c84330, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/72a24b07267c4ab5ae9d918b29defc27_SeqId_44_] to archive 2023-03-19 14:53:45,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:45,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/717765a989a24369bc2230946dd134a3 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/717765a989a24369bc2230946dd134a3 2023-03-19 14:53:45,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/647c517f123f4101bce0963254a6ff06 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/647c517f123f4101bce0963254a6ff06 2023-03-19 14:53:45,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/1bea75e8bd9d4ddf8c1f390abd042ff0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/1bea75e8bd9d4ddf8c1f390abd042ff0 2023-03-19 14:53:45,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/febdc623fe30494eb0a7972dfbf52fa7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/febdc623fe30494eb0a7972dfbf52fa7 2023-03-19 14:53:45,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/f23a124022ad4d4881fd8cd197c6412c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/f23a124022ad4d4881fd8cd197c6412c 2023-03-19 14:53:45,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b0074ee5b8ac4bfd8b8b3560da9bf4e7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b0074ee5b8ac4bfd8b8b3560da9bf4e7 2023-03-19 14:53:45,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d1d9699ee84a44ba81cccc5342cdd400 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d1d9699ee84a44ba81cccc5342cdd400 2023-03-19 14:53:45,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/627a8e59a7db43f8b94bdb3fe37829d4 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/627a8e59a7db43f8b94bdb3fe37829d4 2023-03-19 14:53:45,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b37a7d1565ca459799c0645003c84330 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/b37a7d1565ca459799c0645003c84330 2023-03-19 14:53:45,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/72a24b07267c4ab5ae9d918b29defc27_SeqId_44_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/72a24b07267c4ab5ae9d918b29defc27_SeqId_44_ 2023-03-19 14:53:46,052 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f174ae7208b84bd5af97602acf527baf to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205f174ae7208b84bd5af97602acf527baf 2023-03-19 14:53:46,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:53:46,081 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f0df70bd5df24c88b837638f490658a1 first=Optional[r1] last=Optional[r2] 2023-03-19 14:53:46,082 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f0df70bd5df24c88b837638f490658a1}] 2023-03-19 14:53:46,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f0df70bd5df24c88b837638f490658a1 for inclusion in 388c287f67c220514160956691cb71c1/family1 2023-03-19 14:53:46,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-19 14:53:46,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:53:46,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:46,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f0df70bd5df24c88b837638f490658a1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__btgrp2a9ebblc4qp6209agjt6qplps2rva8qvnq36a7oj2jbafpnf5ghmmsetr54/family1/f0df70bd5df24c88b837638f490658a1 2023-03-19 14:53:46,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__btgrp2a9ebblc4qp6209agjt6qplps2rva8qvnq36a7oj2jbafpnf5ghmmsetr54/family1/f0df70bd5df24c88b837638f490658a1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/60f64f205adc4a448a3e9bf46ef9feab_SeqId_47_ 2023-03-19 14:53:46,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__btgrp2a9ebblc4qp6209agjt6qplps2rva8qvnq36a7oj2jbafpnf5ghmmsetr54/family1/f0df70bd5df24c88b837638f490658a1 into 388c287f67c220514160956691cb71c1/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/60f64f205adc4a448a3e9bf46ef9feab_SeqId_47_ - updating store file list. 2023-03-19 14:53:46,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/60f64f205adc4a448a3e9bf46ef9feab_SeqId_47_ into 388c287f67c220514160956691cb71c1/family1 2023-03-19 14:53:46,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__btgrp2a9ebblc4qp6209agjt6qplps2rva8qvnq36a7oj2jbafpnf5ghmmsetr54/family1/f0df70bd5df24c88b837638f490658a1 into 388c287f67c220514160956691cb71c1/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/60f64f205adc4a448a3e9bf46ef9feab_SeqId_47_) 2023-03-19 14:53:46,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithWeeklyPolicy__btgrp2a9ebblc4qp6209agjt6qplps2rva8qvnq36a7oj2jbafpnf5ghmmsetr54/family1/f0df70bd5df24c88b837638f490658a1 2023-03-19 14:53:46,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-19 14:53:46,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-19 14:53:46,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 388c287f67c220514160956691cb71c1/family1 is initiating minor compaction (all files) 2023-03-19 14:53:46,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@29f384c2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-19 14:53:46,105 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 388c287f67c220514160956691cb71c1/family1 in testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:53:46,105 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/375bf25b5ba146798098938bca8a8cb7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d679a43a638045b6ba050190213713a9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/60f64f205adc4a448a3e9bf46ef9feab_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp, totalSize=176.8 K 2023-03-19 14:53:46,105 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 375bf25b5ba146798098938bca8a8cb7, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878808483 2023-03-19 14:53:46,106 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting d679a43a638045b6ba050190213713a9, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621208483 2023-03-19 14:53:46,106 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 60f64f205adc4a448a3e9bf46ef9feab_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965208483 2023-03-19 14:53:46,107 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:53:46,108 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:46,109 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512015f3e40dfc3b7401e9d32e883dcd8b0e7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512015f3e40dfc3b7401e9d32e883dcd8b0e7 2023-03-19 14:53:46,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205d4b856eeb08548689fc47b02ea893fbc to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205d4b856eeb08548689fc47b02ea893fbc 2023-03-19 14:53:46,111 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-19 14:53:46,111 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-19 14:53:46,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:53:46,111 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:53:46,111 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:53:46,113 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:53:46,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8290 sec 2023-03-19 14:53:46,121 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 388c287f67c220514160956691cb71c1#family1#compaction#35 average throughput is 25.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:53:46,220 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=260 (was 259) - Thread LEAK? -, OpenFileDescriptor=615 (was 612) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 313), ProcessCount=168 (was 168), AvailableMemoryMB=4493 (was 4545) 2023-03-19 14:53:46,230 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260, OpenFileDescriptor=615, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=168, AvailableMemoryMB=4492 2023-03-19 14:53:46,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-19 14:53:46,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:46,235 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:53:46,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-19 14:53:46,236 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:53:46,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-19 14:53:46,238 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598 2023-03-19 14:53:46,238 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:53:46,238 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:53:46,239 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598 empty. 2023-03-19 14:53:46,239 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a empty. 2023-03-19 14:53:46,239 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f empty. 2023-03-19 14:53:46,239 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598 2023-03-19 14:53:46,239 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:53:46,239 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:53:46,239 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-19 14:53:46,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-19 14:53:46,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-19 14:53:46,648 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-19 14:53:46,651 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => e6a399820b946bc182d7646944c64598, NAME => 'testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:53:46,653 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 5777a952ba9f58d5e229708e1fb1584a, NAME => 'testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:53:46,654 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 99ce07afa3cb560229849e2261b8f80f, NAME => 'testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:53:46,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-19 14:53:47,073 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:47,073 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:47,073 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 5777a952ba9f58d5e229708e1fb1584a, disabling compactions & flushes 2023-03-19 14:53:47,074 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing e6a399820b946bc182d7646944c64598, disabling compactions & flushes 2023-03-19 14:53:47,074 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:47,074 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:47,075 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:47,075 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. after waiting 0 ms 2023-03-19 14:53:47,074 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:47,075 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:47,075 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:47,076 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:47,075 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. after waiting 0 ms 2023-03-19 14:53:47,076 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for e6a399820b946bc182d7646944c64598: 2023-03-19 14:53:47,076 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 99ce07afa3cb560229849e2261b8f80f, disabling compactions & flushes 2023-03-19 14:53:47,076 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:47,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:47,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. after waiting 0 ms 2023-03-19 14:53:47,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:47,077 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:47,077 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 99ce07afa3cb560229849e2261b8f80f: 2023-03-19 14:53:47,076 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:47,077 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:47,078 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 5777a952ba9f58d5e229708e1fb1584a: 2023-03-19 14:53:47,081 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:53:47,082 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679237627082"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237627082"}]},"ts":"1679237627082"} 2023-03-19 14:53:47,082 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679237627082"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237627082"}]},"ts":"1679237627082"} 2023-03-19 14:53:47,082 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679237627082"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237627082"}]},"ts":"1679237627082"} 2023-03-19 14:53:47,084 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-19 14:53:47,085 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:53:47,085 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237627085"}]},"ts":"1679237627085"} 2023-03-19 14:53:47,086 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-19 14:53:47,089 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e6a399820b946bc182d7646944c64598, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=99ce07afa3cb560229849e2261b8f80f, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5777a952ba9f58d5e229708e1fb1584a, ASSIGN}] 2023-03-19 14:53:47,090 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5777a952ba9f58d5e229708e1fb1584a, ASSIGN 2023-03-19 14:53:47,090 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=99ce07afa3cb560229849e2261b8f80f, ASSIGN 2023-03-19 14:53:47,090 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e6a399820b946bc182d7646944c64598, ASSIGN 2023-03-19 14:53:47,091 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5777a952ba9f58d5e229708e1fb1584a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:53:47,091 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e6a399820b946bc182d7646944c64598, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:53:47,091 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=99ce07afa3cb560229849e2261b8f80f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:53:47,243 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=5777a952ba9f58d5e229708e1fb1584a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:47,243 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e6a399820b946bc182d7646944c64598, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:47,243 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=99ce07afa3cb560229849e2261b8f80f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:47,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679237627243"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237627243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237627243"}]},"ts":"1679237627243"} 2023-03-19 14:53:47,244 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679237627243"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237627243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237627243"}]},"ts":"1679237627243"} 2023-03-19 14:53:47,244 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679237627243"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237627243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237627243"}]},"ts":"1679237627243"} 2023-03-19 14:53:47,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 5777a952ba9f58d5e229708e1fb1584a, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:47,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure e6a399820b946bc182d7646944c64598, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:47,250 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 99ce07afa3cb560229849e2261b8f80f, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:47,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-19 14:53:47,353 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/.tmp/family1/958424f2609947d88033b2c3f6545961 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/958424f2609947d88033b2c3f6545961 2023-03-19 14:53:47,362 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 388c287f67c220514160956691cb71c1/family1 of 388c287f67c220514160956691cb71c1 into 958424f2609947d88033b2c3f6545961(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:53:47,362 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:53:47,363 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1679237626105; duration=1sec 2023-03-19 14:53:47,363 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:47,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/375bf25b5ba146798098938bca8a8cb7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d679a43a638045b6ba050190213713a9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/60f64f205adc4a448a3e9bf46ef9feab_SeqId_47_] to archive 2023-03-19 14:53:47,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:47,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/375bf25b5ba146798098938bca8a8cb7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/375bf25b5ba146798098938bca8a8cb7 2023-03-19 14:53:47,385 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d679a43a638045b6ba050190213713a9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/d679a43a638045b6ba050190213713a9 2023-03-19 14:53:47,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/60f64f205adc4a448a3e9bf46ef9feab_SeqId_47_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/family1/60f64f205adc4a448a3e9bf46ef9feab_SeqId_47_ 2023-03-19 14:53:47,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:47,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 99ce07afa3cb560229849e2261b8f80f, NAME => 'testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f.', STARTKEY => '1', ENDKEY => '2'} 2023-03-19 14:53:47,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:53:47,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:47,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:53:47,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:53:47,411 INFO [StoreOpener-99ce07afa3cb560229849e2261b8f80f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:53:47,414 DEBUG [StoreOpener-99ce07afa3cb560229849e2261b8f80f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f/family1 2023-03-19 14:53:47,414 DEBUG [StoreOpener-99ce07afa3cb560229849e2261b8f80f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f/family1 2023-03-19 14:53:47,415 INFO [StoreOpener-99ce07afa3cb560229849e2261b8f80f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99ce07afa3cb560229849e2261b8f80f columnFamilyName family1 2023-03-19 14:53:47,417 INFO [StoreOpener-99ce07afa3cb560229849e2261b8f80f-1] regionserver.HStore(310): Store=99ce07afa3cb560229849e2261b8f80f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:47,418 INFO [StoreOpener-99ce07afa3cb560229849e2261b8f80f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:53:47,420 DEBUG [StoreOpener-99ce07afa3cb560229849e2261b8f80f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f/family2 2023-03-19 14:53:47,420 DEBUG [StoreOpener-99ce07afa3cb560229849e2261b8f80f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f/family2 2023-03-19 14:53:47,421 INFO [StoreOpener-99ce07afa3cb560229849e2261b8f80f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99ce07afa3cb560229849e2261b8f80f columnFamilyName family2 2023-03-19 14:53:47,423 INFO [StoreOpener-99ce07afa3cb560229849e2261b8f80f-1] regionserver.HStore(310): Store=99ce07afa3cb560229849e2261b8f80f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:47,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:53:47,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:53:47,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:53:47,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:53:47,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:53:47,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 99ce07afa3cb560229849e2261b8f80f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62401084, jitterRate=-0.07015138864517212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:53:47,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 99ce07afa3cb560229849e2261b8f80f: 2023-03-19 14:53:47,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f., pid=33, masterSystemTime=1679237627401 2023-03-19 14:53:47,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:47,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:47,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:47,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5777a952ba9f58d5e229708e1fb1584a, NAME => 'testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a.', STARTKEY => '2', ENDKEY => ''} 2023-03-19 14:53:47,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:53:47,436 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=99ce07afa3cb560229849e2261b8f80f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:47,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:47,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:53:47,436 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1679237627436"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237627436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237627436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237627436"}]},"ts":"1679237627436"} 2023-03-19 14:53:47,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:53:47,439 INFO [StoreOpener-5777a952ba9f58d5e229708e1fb1584a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:53:47,440 DEBUG [StoreOpener-5777a952ba9f58d5e229708e1fb1584a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1 2023-03-19 14:53:47,440 DEBUG [StoreOpener-5777a952ba9f58d5e229708e1fb1584a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1 2023-03-19 14:53:47,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=29 2023-03-19 14:53:47,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 99ce07afa3cb560229849e2261b8f80f, server=jenkins-hbase20.apache.org,33191,1679237584457 in 189 msec 2023-03-19 14:53:47,441 INFO [StoreOpener-5777a952ba9f58d5e229708e1fb1584a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5777a952ba9f58d5e229708e1fb1584a columnFamilyName family1 2023-03-19 14:53:47,442 INFO [StoreOpener-5777a952ba9f58d5e229708e1fb1584a-1] regionserver.HStore(310): Store=5777a952ba9f58d5e229708e1fb1584a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:47,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=99ce07afa3cb560229849e2261b8f80f, ASSIGN in 353 msec 2023-03-19 14:53:47,443 INFO [StoreOpener-5777a952ba9f58d5e229708e1fb1584a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:53:47,444 DEBUG [StoreOpener-5777a952ba9f58d5e229708e1fb1584a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family2 2023-03-19 14:53:47,444 DEBUG [StoreOpener-5777a952ba9f58d5e229708e1fb1584a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family2 2023-03-19 14:53:47,445 INFO [StoreOpener-5777a952ba9f58d5e229708e1fb1584a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5777a952ba9f58d5e229708e1fb1584a columnFamilyName family2 2023-03-19 14:53:47,446 INFO [StoreOpener-5777a952ba9f58d5e229708e1fb1584a-1] regionserver.HStore(310): Store=5777a952ba9f58d5e229708e1fb1584a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:47,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:53:47,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:53:47,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:53:47,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:53:47,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:53:47,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5777a952ba9f58d5e229708e1fb1584a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63636267, jitterRate=-0.05174572765827179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:53:47,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5777a952ba9f58d5e229708e1fb1584a: 2023-03-19 14:53:47,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a., pid=31, masterSystemTime=1679237627401 2023-03-19 14:53:47,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:47,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:47,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:47,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6a399820b946bc182d7646944c64598, NAME => 'testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598.', STARTKEY => '', ENDKEY => '1'} 2023-03-19 14:53:47,456 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=5777a952ba9f58d5e229708e1fb1584a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:47,456 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679237627456"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237627456"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237627456"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237627456"}]},"ts":"1679237627456"} 2023-03-19 14:53:47,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles e6a399820b946bc182d7646944c64598 2023-03-19 14:53:47,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:47,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e6a399820b946bc182d7646944c64598 2023-03-19 14:53:47,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e6a399820b946bc182d7646944c64598 2023-03-19 14:53:47,458 INFO [StoreOpener-e6a399820b946bc182d7646944c64598-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e6a399820b946bc182d7646944c64598 2023-03-19 14:53:47,459 DEBUG [StoreOpener-e6a399820b946bc182d7646944c64598-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598/family1 2023-03-19 14:53:47,459 DEBUG [StoreOpener-e6a399820b946bc182d7646944c64598-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598/family1 2023-03-19 14:53:47,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=30 2023-03-19 14:53:47,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 5777a952ba9f58d5e229708e1fb1584a, server=jenkins-hbase20.apache.org,33191,1679237584457 in 210 msec 2023-03-19 14:53:47,460 INFO [StoreOpener-e6a399820b946bc182d7646944c64598-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6a399820b946bc182d7646944c64598 columnFamilyName family1 2023-03-19 14:53:47,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5777a952ba9f58d5e229708e1fb1584a, ASSIGN in 372 msec 2023-03-19 14:53:47,461 INFO [StoreOpener-e6a399820b946bc182d7646944c64598-1] regionserver.HStore(310): Store=e6a399820b946bc182d7646944c64598/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:47,462 INFO [StoreOpener-e6a399820b946bc182d7646944c64598-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e6a399820b946bc182d7646944c64598 2023-03-19 14:53:47,463 DEBUG [StoreOpener-e6a399820b946bc182d7646944c64598-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598/family2 2023-03-19 14:53:47,463 DEBUG [StoreOpener-e6a399820b946bc182d7646944c64598-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598/family2 2023-03-19 14:53:47,463 INFO [StoreOpener-e6a399820b946bc182d7646944c64598-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6a399820b946bc182d7646944c64598 columnFamilyName family2 2023-03-19 14:53:47,464 INFO [StoreOpener-e6a399820b946bc182d7646944c64598-1] regionserver.HStore(310): Store=e6a399820b946bc182d7646944c64598/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:47,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598 2023-03-19 14:53:47,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598 2023-03-19 14:53:47,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:53:47,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e6a399820b946bc182d7646944c64598 2023-03-19 14:53:47,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:53:47,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e6a399820b946bc182d7646944c64598; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73490442, jitterRate=0.09509292244911194}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:53:47,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e6a399820b946bc182d7646944c64598: 2023-03-19 14:53:47,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598., pid=32, masterSystemTime=1679237627401 2023-03-19 14:53:47,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:47,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:47,473 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e6a399820b946bc182d7646944c64598, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:47,474 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1679237627473"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237627473"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237627473"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237627473"}]},"ts":"1679237627473"} 2023-03-19 14:53:47,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-03-19 14:53:47,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure e6a399820b946bc182d7646944c64598, server=jenkins-hbase20.apache.org,33191,1679237584457 in 227 msec 2023-03-19 14:53:47,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-03-19 14:53:47,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e6a399820b946bc182d7646944c64598, ASSIGN in 389 msec 2023-03-19 14:53:47,480 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:53:47,480 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237627480"}]},"ts":"1679237627480"} 2023-03-19 14:53:47,481 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-19 14:53:47,483 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:53:47,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2510 sec 2023-03-19 14:53:48,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-19 14:53:48,345 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-19 14:53:48,348 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-19 14:53:48,371 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:53:48,372 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d820848 to 127.0.0.1:56323 2023-03-19 14:53:48,372 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:53:48,373 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:53:48,373 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x075e7d7f to 127.0.0.1:56323 2023-03-19 14:53:48,373 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:53:48,374 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:53:48,374 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3138e2bb to 127.0.0.1:56323 2023-03-19 14:53:48,374 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:53:48,374 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:53:48,374 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39c7bf3b to 127.0.0.1:56323 2023-03-19 14:53:48,374 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:53:48,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:48,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:48,380 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-19 14:53:48,380 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:48,381 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-19 14:53:48,381 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-19 14:53:48,381 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:48,381 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:48,382 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:48,382 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:48,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:48,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:48,382 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:48,382 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:48,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:48,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:48,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:48,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:48,383 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:48,383 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:48,383 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-19 14:53:48,383 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:48,383 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-19 14:53:48,386 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:48,386 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:48,386 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. started... 2023-03-19 14:53:48,386 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:53:48,386 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:48,386 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. started... 2023-03-19 14:53:48,387 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 99ce07afa3cb560229849e2261b8f80f: 2023-03-19 14:53:48,387 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:48,387 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e6a399820b946bc182d7646944c64598: 2023-03-19 14:53:48,387 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:48,386 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:48,387 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. started... 2023-03-19 14:53:48,387 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:53:48,388 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5777a952ba9f58d5e229708e1fb1584a 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-19 14:53:48,388 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:53:48,812 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319793704ee8efb4f33a41061276d81b3ab to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230319793704ee8efb4f33a41061276d81b3ab 2023-03-19 14:53:49,219 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/.tmp/family1/4b71a3f8d085480ea69e4fa5971f9fed 2023-03-19 14:53:49,225 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/.tmp/family1/4b71a3f8d085480ea69e4fa5971f9fed as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/4b71a3f8d085480ea69e4fa5971f9fed 2023-03-19 14:53:49,230 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/4b71a3f8d085480ea69e4fa5971f9fed, entries=1, sequenceid=5, filesize=4.9 K 2023-03-19 14:53:49,231 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 5777a952ba9f58d5e229708e1fb1584a in 843ms, sequenceid=5, compaction requested=false 2023-03-19 14:53:49,232 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5777a952ba9f58d5e229708e1fb1584a: 2023-03-19 14:53:49,232 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:49,232 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:53:49,232 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:53:49,232 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,232 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-19 14:53:49,232 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-19 14:53:49,233 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,233 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:49,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:49,233 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,233 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:49,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-19 14:53:49,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e988cb0[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:49,235 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-19 14:53:49,235 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,236 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,236 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-19 14:53:49,236 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-19 14:53:49,236 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:49,237 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,237 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:49,237 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,237 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-19 14:53:49,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:49,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:49,237 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:49,237 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-19 14:53:49,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:49,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:49,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:49,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-19 14:53:49,239 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-19 14:53:49,239 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:49,239 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:49,239 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,239 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:49,240 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:49,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:49,240 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,240 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:49,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:49,241 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,242 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,245 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,245 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:49,245 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:49,245 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,245 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-19 14:53:49,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:49,245 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:49,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-19 14:53:49,245 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,245 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:49,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:49,245 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,245 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,245 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:49,246 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:49,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:49,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:49,346 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:49,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:49,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:49,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:49,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,354 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-19 14:53:49,354 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:49,354 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-19 14:53:49,354 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-19 14:53:49,354 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,354 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,355 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:49,355 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:49,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:49,355 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,355 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:49,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:49,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,356 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,356 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-19 14:53:49,356 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,356 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-19 14:53:49,356 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:49,356 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-19 14:53:49,356 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:49,357 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. started... 2023-03-19 14:53:49,357 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e6a399820b946bc182d7646944c64598: 2023-03-19 14:53:49,357 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:53:49,364 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:49,364 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. started... 2023-03-19 14:53:49,364 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 99ce07afa3cb560229849e2261b8f80f: 2023-03-19 14:53:49,364 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:53:49,364 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:53:49,364 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:49,364 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:49,364 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:53:49,364 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. started... 2023-03-19 14:53:49,365 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:53:49,365 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5777a952ba9f58d5e229708e1fb1584a 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-19 14:53:49,393 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303195237097cd3d044518c1fe046b9b4fc67 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303195237097cd3d044518c1fe046b9b4fc67 2023-03-19 14:53:49,799 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/.tmp/family1/f010e2b264194fd0a4a27af2c404bc50 2023-03-19 14:53:49,810 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/.tmp/family1/f010e2b264194fd0a4a27af2c404bc50 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/f010e2b264194fd0a4a27af2c404bc50 2023-03-19 14:53:49,818 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/f010e2b264194fd0a4a27af2c404bc50, entries=2, sequenceid=9, filesize=5.0 K 2023-03-19 14:53:49,819 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 5777a952ba9f58d5e229708e1fb1584a in 454ms, sequenceid=9, compaction requested=false 2023-03-19 14:53:49,819 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5777a952ba9f58d5e229708e1fb1584a: 2023-03-19 14:53:49,819 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:49,820 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:53:49,820 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:53:49,820 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,820 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-19 14:53:49,820 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-19 14:53:49,821 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,821 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:49,822 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,822 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:49,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-19 14:53:49,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a9c88d6[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:49,824 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-19 14:53:49,824 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,825 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-19 14:53:49,825 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-19 14:53:49,825 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:49,825 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,825 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:49,826 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-19 14:53:49,826 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:49,826 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-19 14:53:49,826 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:49,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-19 14:53:49,829 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-19 14:53:49,829 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:49,829 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:49,829 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,829 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:49,831 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,831 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:49,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,831 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:49,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:49,831 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,833 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,835 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,835 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:49,835 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:49,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:49,835 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:49,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-19 14:53:49,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:49,836 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:49,836 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:49,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:49,836 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:49,836 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,836 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:49,836 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,836 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,836 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:49,937 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:49,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:49,949 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-19 14:53:49,952 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-19 14:53:49,952 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-19 14:53:49,953 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:53:49,953 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238229953 2023-03-19 14:53:49,954 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:53:49,954 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-19 14:53:49,954 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-19 14:53:49,955 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x08c486ad to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:53:49,959 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27f6da90, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:53:49,959 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230319 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-19 14:53:50,791 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303192bf024638b8c414abf40934b85deb185 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303192bf024638b8c414abf40934b85deb185 2023-03-19 14:53:50,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230319 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-19 14:53:50,808 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:53:50,809 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36712, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:53:50,816 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:53:50,818 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56726, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:53:50,828 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230319/family1/7fde20ee2f9d491eaf641cf3eb512221 first=Optional[k0] last=Optional[k1] 2023-03-19 14:53:50,829 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230319/family1/7fde20ee2f9d491eaf641cf3eb512221}] 2023-03-19 14:53:50,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230319/family1/7fde20ee2f9d491eaf641cf3eb512221 for inclusion in 5777a952ba9f58d5e229708e1fb1584a/family1 2023-03-19 14:53:50,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-19 14:53:50,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-19 14:53:50,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 5777a952ba9f58d5e229708e1fb1584a: 2023-03-19 14:53:50,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230319/family1/7fde20ee2f9d491eaf641cf3eb512221 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testScannerOnBulkLoadRefHFiles__e986gk42uq8umd4t599i34d3d3jb7alikp5s0vrb4qaj5lvsarjgd7s63pka42rr/family1/7fde20ee2f9d491eaf641cf3eb512221 2023-03-19 14:53:50,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testScannerOnBulkLoadRefHFiles__e986gk42uq8umd4t599i34d3d3jb7alikp5s0vrb4qaj5lvsarjgd7s63pka42rr/family1/7fde20ee2f9d491eaf641cf3eb512221 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/6922aad5842c4084bbda9ee08a8976ac_SeqId_12_ 2023-03-19 14:53:50,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testScannerOnBulkLoadRefHFiles__e986gk42uq8umd4t599i34d3d3jb7alikp5s0vrb4qaj5lvsarjgd7s63pka42rr/family1/7fde20ee2f9d491eaf641cf3eb512221 into 5777a952ba9f58d5e229708e1fb1584a/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/6922aad5842c4084bbda9ee08a8976ac_SeqId_12_ - updating store file list. 2023-03-19 14:53:50,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/6922aad5842c4084bbda9ee08a8976ac_SeqId_12_ into 5777a952ba9f58d5e229708e1fb1584a/family1 2023-03-19 14:53:50,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testScannerOnBulkLoadRefHFiles__e986gk42uq8umd4t599i34d3d3jb7alikp5s0vrb4qaj5lvsarjgd7s63pka42rr/family1/7fde20ee2f9d491eaf641cf3eb512221 into 5777a952ba9f58d5e229708e1fb1584a/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/6922aad5842c4084bbda9ee08a8976ac_SeqId_12_) 2023-03-19 14:53:50,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testScannerOnBulkLoadRefHFiles__e986gk42uq8umd4t599i34d3d3jb7alikp5s0vrb4qaj5lvsarjgd7s63pka42rr/family1/7fde20ee2f9d491eaf641cf3eb512221 2023-03-19 14:53:50,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-19 14:53:50,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-19 14:53:50,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 5777a952ba9f58d5e229708e1fb1584a/family1 is initiating minor compaction (all files) 2023-03-19 14:53:50,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@13dd9062; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-19 14:53:50,847 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 5777a952ba9f58d5e229708e1fb1584a/family1 in testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:53:50,847 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/4b71a3f8d085480ea69e4fa5971f9fed, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/f010e2b264194fd0a4a27af2c404bc50, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/6922aad5842c4084bbda9ee08a8976ac_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/.tmp, totalSize=15.1 K 2023-03-19 14:53:50,847 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 4b71a3f8d085480ea69e4fa5971f9fed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237628346 2023-03-19 14:53:50,848 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting f010e2b264194fd0a4a27af2c404bc50, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237628346 2023-03-19 14:53:50,848 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 6922aad5842c4084bbda9ee08a8976ac_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237628346 2023-03-19 14:53:50,848 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230319 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-19 14:53:50,849 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:50,851 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303195237097cd3d044518c1fe046b9b4fc67 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202303195237097cd3d044518c1fe046b9b4fc67 2023-03-19 14:53:50,852 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230319793704ee8efb4f33a41061276d81b3ab to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230319793704ee8efb4f33a41061276d81b3ab 2023-03-19 14:53:50,852 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-19 14:53:50,852 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230319' 2023-03-19 14:53:50,853 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230319 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-19 14:53:50,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-19 14:53:50,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:53:50,854 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-19 14:53:50,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 903 msec 2023-03-19 14:53:50,858 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] throttle.PressureAwareThroughputController(145): 5777a952ba9f58d5e229708e1fb1584a#family1#compaction#38 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:53:50,894 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=248 (was 260), OpenFileDescriptor=586 (was 615), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=272 (was 243) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4443 (was 4492) 2023-03-19 14:53:50,903 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=248, OpenFileDescriptor=586, MaxFileDescriptor=60000, SystemLoadAverage=272, ProcessCount=168, AvailableMemoryMB=4443 2023-03-19 14:53:50,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-19 14:53:50,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:50,907 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:53:50,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-19 14:53:50,908 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:53:50,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-19 14:53:50,909 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7 2023-03-19 14:53:50,910 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7 empty. 2023-03-19 14:53:50,910 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7 2023-03-19 14:53:50,910 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-19 14:53:51,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-19 14:53:51,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-19 14:53:51,322 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-19 14:53:51,324 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4b7e555dc6c9decb145e8efe79d877a7, NAME => 'testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:53:51,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-19 14:53:51,733 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:51,733 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 4b7e555dc6c9decb145e8efe79d877a7, disabling compactions & flushes 2023-03-19 14:53:51,733 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:51,734 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:51,734 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. after waiting 0 ms 2023-03-19 14:53:51,734 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:51,734 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:51,734 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:53:51,738 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:53:51,740 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679237631739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237631739"}]},"ts":"1679237631739"} 2023-03-19 14:53:51,742 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-19 14:53:51,743 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:53:51,743 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237631743"}]},"ts":"1679237631743"} 2023-03-19 14:53:51,744 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-19 14:53:51,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4b7e555dc6c9decb145e8efe79d877a7, ASSIGN}] 2023-03-19 14:53:51,749 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4b7e555dc6c9decb145e8efe79d877a7, ASSIGN 2023-03-19 14:53:51,749 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4b7e555dc6c9decb145e8efe79d877a7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:53:51,901 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4b7e555dc6c9decb145e8efe79d877a7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:51,901 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679237631901"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237631901"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237631901"}]},"ts":"1679237631901"} 2023-03-19 14:53:51,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 4b7e555dc6c9decb145e8efe79d877a7, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:53:52,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-19 14:53:52,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:52,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b7e555dc6c9decb145e8efe79d877a7, NAME => 'testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:53:52,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 4b7e555dc6c9decb145e8efe79d877a7 2023-03-19 14:53:52,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:53:52,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4b7e555dc6c9decb145e8efe79d877a7 2023-03-19 14:53:52,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4b7e555dc6c9decb145e8efe79d877a7 2023-03-19 14:53:52,071 INFO [StoreOpener-4b7e555dc6c9decb145e8efe79d877a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4b7e555dc6c9decb145e8efe79d877a7 2023-03-19 14:53:52,073 DEBUG [StoreOpener-4b7e555dc6c9decb145e8efe79d877a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1 2023-03-19 14:53:52,073 DEBUG [StoreOpener-4b7e555dc6c9decb145e8efe79d877a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1 2023-03-19 14:53:52,074 INFO [StoreOpener-4b7e555dc6c9decb145e8efe79d877a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b7e555dc6c9decb145e8efe79d877a7 columnFamilyName family1 2023-03-19 14:53:52,075 INFO [StoreOpener-4b7e555dc6c9decb145e8efe79d877a7-1] regionserver.HStore(310): Store=4b7e555dc6c9decb145e8efe79d877a7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:53:52,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7 2023-03-19 14:53:52,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7 2023-03-19 14:53:52,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4b7e555dc6c9decb145e8efe79d877a7 2023-03-19 14:53:52,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:53:52,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4b7e555dc6c9decb145e8efe79d877a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58909356, jitterRate=-0.12218219041824341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:53:52,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:53:52,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7., pid=37, masterSystemTime=1679237632059 2023-03-19 14:53:52,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:52,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:52,087 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4b7e555dc6c9decb145e8efe79d877a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:52,088 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1679237632087"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237632087"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237632087"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237632087"}]},"ts":"1679237632087"} 2023-03-19 14:53:52,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-19 14:53:52,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 4b7e555dc6c9decb145e8efe79d877a7, server=jenkins-hbase20.apache.org,33191,1679237584457 in 185 msec 2023-03-19 14:53:52,094 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/.tmp/family1/d0a19c38d85946d987233cd132ada757 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/d0a19c38d85946d987233cd132ada757 2023-03-19 14:53:52,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-19 14:53:52,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4b7e555dc6c9decb145e8efe79d877a7, ASSIGN in 345 msec 2023-03-19 14:53:52,096 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:53:52,096 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237632096"}]},"ts":"1679237632096"} 2023-03-19 14:53:52,098 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-19 14:53:52,100 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:53:52,100 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5777a952ba9f58d5e229708e1fb1584a/family1 of 5777a952ba9f58d5e229708e1fb1584a into d0a19c38d85946d987233cd132ada757(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:53:52,100 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5777a952ba9f58d5e229708e1fb1584a: 2023-03-19 14:53:52,101 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1679237630846; duration=1sec 2023-03-19 14:53:52,101 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:53:52,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1960 sec 2023-03-19 14:53:52,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/4b71a3f8d085480ea69e4fa5971f9fed, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/f010e2b264194fd0a4a27af2c404bc50, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/6922aad5842c4084bbda9ee08a8976ac_SeqId_12_] to archive 2023-03-19 14:53:52,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:53:52,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/4b71a3f8d085480ea69e4fa5971f9fed to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/4b71a3f8d085480ea69e4fa5971f9fed 2023-03-19 14:53:52,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/f010e2b264194fd0a4a27af2c404bc50 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/f010e2b264194fd0a4a27af2c404bc50 2023-03-19 14:53:52,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/6922aad5842c4084bbda9ee08a8976ac_SeqId_12_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/family1/6922aad5842c4084bbda9ee08a8976ac_SeqId_12_ 2023-03-19 14:53:52,940 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:53:53,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-19 14:53:53,020 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-19 14:53:53,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:53,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,051 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:53,051 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:53,051 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:53,051 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:53,051 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,052 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,052 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,052 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:53,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:53,053 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,053 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:53,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,054 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,054 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,054 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:53,054 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:53,054 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:53,054 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:53,054 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:53,054 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:53,054 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. started... 2023-03-19 14:53:53,055 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4b7e555dc6c9decb145e8efe79d877a7 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-19 14:53:53,483 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130208d7c4f370f4fe5afe24faed572e0a2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130208d7c4f370f4fe5afe24faed572e0a2 2023-03-19 14:53:53,890 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/e049a598f5c6470f8d51dae44764ebd0 2023-03-19 14:53:53,903 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/e049a598f5c6470f8d51dae44764ebd0 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/e049a598f5c6470f8d51dae44764ebd0 2023-03-19 14:53:53,909 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/e049a598f5c6470f8d51dae44764ebd0, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-19 14:53:53,909 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4b7e555dc6c9decb145e8efe79d877a7 in 854ms, sequenceid=5, compaction requested=false 2023-03-19 14:53:53,910 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:53,910 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:53:53,910 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:53,910 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:53,910 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:53,910 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,910 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:53,910 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:53,911 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,911 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:53,912 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,912 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:53,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:53,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63a914e8[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:53,913 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:53,913 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,913 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,914 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:53,914 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:53,914 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:53,914 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,914 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:53,914 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:53,914 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,914 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:53,914 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:53,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:53,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:53,916 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:53,916 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:53,916 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:53,916 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,916 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:53,917 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,917 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:53,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:53,917 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:53,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:53,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:53,917 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,918 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:53,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,919 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,920 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,920 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:53,920 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,920 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:53,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:53,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:53,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:53,920 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:53,920 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:53,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:53,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:53,920 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:53,920 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,920 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:53,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:53,920 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:53,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:53,920 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,020 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:54,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:54,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:54,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:54,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,028 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:54,028 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:54,028 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:54,028 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:54,029 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,029 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,030 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,030 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:54,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:54,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:54,030 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,030 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:54,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:54,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,031 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,031 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:54,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,032 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:54,032 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:54,032 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:54,032 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:54,032 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:54,032 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:54,032 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. started... 2023-03-19 14:53:54,032 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4b7e555dc6c9decb145e8efe79d877a7 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-19 14:53:54,459 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e7ff7a69649040eb8bc449aede68e773 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128e7ff7a69649040eb8bc449aede68e773 2023-03-19 14:53:54,868 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/4e38ea87982747ac8d44c7a09fa5050f 2023-03-19 14:53:54,881 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/4e38ea87982747ac8d44c7a09fa5050f as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4e38ea87982747ac8d44c7a09fa5050f 2023-03-19 14:53:54,889 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4e38ea87982747ac8d44c7a09fa5050f, entries=1, sequenceid=9, filesize=5.0 K 2023-03-19 14:53:54,890 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4b7e555dc6c9decb145e8efe79d877a7 in 858ms, sequenceid=9, compaction requested=false 2023-03-19 14:53:54,890 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:53:54,890 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:54,891 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:54,891 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:54,891 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,891 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:54,891 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:54,893 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,893 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:54,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:54,894 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,894 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:54,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:54,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:54,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:54,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:54,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@724f47f3[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:54,897 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:54,897 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,898 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,898 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:54,898 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:54,898 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:54,898 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,898 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:54,900 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,900 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:54,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:54,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:54,900 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:54,901 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:54,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:54,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:54,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:54,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:54,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:54,905 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:54,905 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:54,905 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:54,906 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,906 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:54,919 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,919 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:54,919 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:54,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:54,920 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:54,921 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,927 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,927 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:54,927 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:54,927 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:54,927 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,927 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,927 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:54,927 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,927 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,928 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:54,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:54,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:54,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:54,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:54,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:54,928 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:54,928 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:54,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:54,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:55,028 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:55,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:55,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:55,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:55,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,042 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:55,042 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:55,042 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:55,042 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:55,043 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,043 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,044 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:55,044 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:55,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:55,044 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,044 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:55,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:55,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,045 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,045 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:55,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,045 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:55,045 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:55,045 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:55,046 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:55,046 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:55,046 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:55,046 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. started... 2023-03-19 14:53:55,046 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4b7e555dc6c9decb145e8efe79d877a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:55,467 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e28c63c62d434918bd5e53ab97d2853b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201e28c63c62d434918bd5e53ab97d2853b 2023-03-19 14:53:55,876 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/ad63ccdc3201478c8c65e62a31ae3427 2023-03-19 14:53:55,887 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/ad63ccdc3201478c8c65e62a31ae3427 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/ad63ccdc3201478c8c65e62a31ae3427 2023-03-19 14:53:55,892 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/ad63ccdc3201478c8c65e62a31ae3427, entries=1, sequenceid=13, filesize=4.9 K 2023-03-19 14:53:55,893 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b7e555dc6c9decb145e8efe79d877a7 in 847ms, sequenceid=13, compaction requested=true 2023-03-19 14:53:55,893 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:53:55,893 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:55,893 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:55,893 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:55,893 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,893 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:55,893 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:55,894 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,894 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:55,895 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,895 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:55,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:55,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8c8a806[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:55,897 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:55,897 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,898 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,898 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:55,898 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:55,898 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:55,898 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,898 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:55,899 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,899 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:55,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:55,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:55,899 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:55,899 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:55,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:55,902 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:55,902 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:55,902 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:55,902 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,902 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:55,903 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,903 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:55,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,903 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:55,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:55,904 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:55,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,905 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:55,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,907 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,908 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,908 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,908 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:55,908 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:55,908 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:55,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:55,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:55,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:55,908 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:55,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:55,908 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:55,908 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,908 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:55,908 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:55,908 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:55,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:55,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:56,009 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:56,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:56,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:56,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:56,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,015 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:56,015 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:56,015 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:56,015 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:56,015 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,015 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,016 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:56,016 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:56,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:56,016 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,016 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:56,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,017 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:56,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,017 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,017 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:56,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,018 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:56,018 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:56,018 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:56,018 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:56,018 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:56,018 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:56,018 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. started... 2023-03-19 14:53:56,018 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4b7e555dc6c9decb145e8efe79d877a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:56,434 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c49be9626a5646ba90c9e4a1c5191299 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c49be9626a5646ba90c9e4a1c5191299 2023-03-19 14:53:56,844 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/4656a6921a8148058955b85d0ac68163 2023-03-19 14:53:56,853 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/4656a6921a8148058955b85d0ac68163 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4656a6921a8148058955b85d0ac68163 2023-03-19 14:53:56,860 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4656a6921a8148058955b85d0ac68163, entries=1, sequenceid=17, filesize=4.9 K 2023-03-19 14:53:56,861 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b7e555dc6c9decb145e8efe79d877a7 in 843ms, sequenceid=17, compaction requested=true 2023-03-19 14:53:56,861 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:53:56,861 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:56,861 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:56,861 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:56,861 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,862 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:56,862 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:56,864 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,864 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:56,864 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:56,864 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:56,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:56,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@168c5bf1[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:56,866 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:56,867 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,867 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,868 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:56,868 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:56,868 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:56,868 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,868 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:56,869 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:56,869 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:56,869 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:56,869 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:56,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:56,872 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:56,873 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:56,873 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:56,873 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,873 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:56,877 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,877 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:56,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:56,877 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:56,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:56,878 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:56,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:56,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:56,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,880 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:56,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,886 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,886 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,886 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:56,886 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:56,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:56,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:56,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:56,886 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:56,886 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:56,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:56,887 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:56,887 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:56,887 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:56,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:56,887 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:56,887 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,887 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:56,987 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:56,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:57,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:57,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:57,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,002 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:57,002 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:57,002 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:57,002 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:57,003 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,003 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,005 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:57,005 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:57,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:57,006 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,006 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:57,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:57,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,008 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,008 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:57,008 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,008 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:57,008 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:57,008 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:57,008 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:57,008 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:57,009 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:57,009 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. started... 2023-03-19 14:53:57,009 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4b7e555dc6c9decb145e8efe79d877a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:57,436 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282ed0c9a778ed42888df8c9e7556db507 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512282ed0c9a778ed42888df8c9e7556db507 2023-03-19 14:53:57,845 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/29a88ccf6d854f259c64238859e6890a 2023-03-19 14:53:57,857 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/29a88ccf6d854f259c64238859e6890a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/29a88ccf6d854f259c64238859e6890a 2023-03-19 14:53:57,864 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/29a88ccf6d854f259c64238859e6890a, entries=1, sequenceid=21, filesize=4.9 K 2023-03-19 14:53:57,865 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b7e555dc6c9decb145e8efe79d877a7 in 856ms, sequenceid=21, compaction requested=true 2023-03-19 14:53:57,865 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:53:57,865 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:57,865 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:57,865 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:57,865 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,865 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:57,865 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:57,867 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,867 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:57,867 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,867 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:57,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:57,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d29039c[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:57,869 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:57,869 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,870 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,871 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:57,871 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:57,871 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:57,871 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,871 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:57,872 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,872 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:57,872 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:57,872 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:57,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:57,875 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:57,875 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:57,875 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:57,875 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,875 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:57,876 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,876 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,876 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:57,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:57,877 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,877 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:57,879 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:57,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:57,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:57,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:57,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:57,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:57,879 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:57,980 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:57,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:57,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:57,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:57,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,991 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:57,991 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:57,992 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:57,992 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:57,992 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,992 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,993 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,993 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:57,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:57,993 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:57,993 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:57,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:57,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,994 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,995 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:57,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:57,995 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:57,995 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:57,995 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:57,995 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:57,995 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:57,995 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:57,995 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. started... 2023-03-19 14:53:57,995 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4b7e555dc6c9decb145e8efe79d877a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:58,413 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c4dc6636370f4211bbe4490f20c8fb06 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c4dc6636370f4211bbe4490f20c8fb06 2023-03-19 14:53:58,822 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/1bf290c0467645d3bc0e50bf481f7a87 2023-03-19 14:53:58,828 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/1bf290c0467645d3bc0e50bf481f7a87 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1bf290c0467645d3bc0e50bf481f7a87 2023-03-19 14:53:58,832 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1bf290c0467645d3bc0e50bf481f7a87, entries=1, sequenceid=25, filesize=4.9 K 2023-03-19 14:53:58,833 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b7e555dc6c9decb145e8efe79d877a7 in 838ms, sequenceid=25, compaction requested=true 2023-03-19 14:53:58,833 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:53:58,833 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:58,833 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:58,833 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:58,834 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,834 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:58,834 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:58,835 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,835 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:58,835 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,835 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:58,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:58,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:58,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35d1bb15[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:58,836 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:58,836 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,837 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,837 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:58,837 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:58,837 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:58,837 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,837 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:58,837 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,837 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:58,837 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:58,838 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:58,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:58,839 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:58,839 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:58,839 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:58,839 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,839 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:58,840 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,840 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:58,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:58,840 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:58,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:58,840 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:58,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:58,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:58,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,841 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:58,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,843 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,843 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:58,843 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:58,843 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,843 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,843 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,843 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,843 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:58,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:58,843 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:58,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:58,843 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:58,843 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:58,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:58,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:58,844 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:58,944 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:58,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:58,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:58,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:58,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,949 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:58,949 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:58,949 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:58,949 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:58,949 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,950 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,950 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,950 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:58,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:58,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:58,950 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:58,951 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:58,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:58,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,951 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,952 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:58,952 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:58,952 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:58,952 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:58,952 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:58,952 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:58,952 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:58,952 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:58,952 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. started... 2023-03-19 14:53:58,952 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4b7e555dc6c9decb145e8efe79d877a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:53:59,366 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f0c6011da15c4fbf9e7559658b02af3c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0c6011da15c4fbf9e7559658b02af3c 2023-03-19 14:53:59,772 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/893def6e626942aeaba860c56d1c1b70 2023-03-19 14:53:59,777 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/893def6e626942aeaba860c56d1c1b70 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/893def6e626942aeaba860c56d1c1b70 2023-03-19 14:53:59,782 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/893def6e626942aeaba860c56d1c1b70, entries=1, sequenceid=29, filesize=4.9 K 2023-03-19 14:53:59,783 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b7e555dc6c9decb145e8efe79d877a7 in 831ms, sequenceid=29, compaction requested=true 2023-03-19 14:53:59,783 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:53:59,783 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:59,783 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:53:59,783 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:53:59,783 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,784 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:53:59,784 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:53:59,785 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,785 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:59,785 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,785 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:53:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:59,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:59,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:59,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:53:59,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7894ad31[Count = 0] remaining members to acquire global barrier 2023-03-19 14:53:59,786 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:53:59,787 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,787 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,787 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:53:59,787 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:53:59,787 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:53:59,787 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,787 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:53:59,788 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:53:59,788 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,788 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:59,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:59,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:59,788 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:53:59,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:59,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:59,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:59,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:53:59,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:53:59,790 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:53:59,790 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:53:59,790 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:53:59,790 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,790 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:53:59,791 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,791 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,792 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:59,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:53:59,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:53:59,792 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:59,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:59,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:53:59,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:53:59,793 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:53:59,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,796 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,796 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:59,796 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,796 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:53:59,796 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:53:59,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:59,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:59,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:59,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:53:59,796 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,796 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:53:59,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:53:59,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:53:59,797 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:53:59,797 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:53:59,796 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,797 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,797 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,897 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:53:59,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:53:59,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:53:59,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:53:59,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,904 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:53:59,904 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:59,904 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:53:59,904 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:53:59,904 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,904 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,905 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,905 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:53:59,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:53:59,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:53:59,905 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:53:59,905 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:53:59,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:53:59,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,906 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:53:59,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:53:59,906 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:53:59,906 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:53:59,906 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:53:59,911 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:53:59,911 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:53:59,911 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:53:59,911 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. started... 2023-03-19 14:53:59,911 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4b7e555dc6c9decb145e8efe79d877a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:00,340 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cbe04e7beaeb4658abdf916cb9ca4e4e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103cbe04e7beaeb4658abdf916cb9ca4e4e 2023-03-19 14:54:00,750 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/796b8c983f834cdfbcfebdb28cfe8efe 2023-03-19 14:54:00,755 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/796b8c983f834cdfbcfebdb28cfe8efe as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/796b8c983f834cdfbcfebdb28cfe8efe 2023-03-19 14:54:00,759 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/796b8c983f834cdfbcfebdb28cfe8efe, entries=1, sequenceid=33, filesize=4.9 K 2023-03-19 14:54:00,760 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b7e555dc6c9decb145e8efe79d877a7 in 849ms, sequenceid=33, compaction requested=true 2023-03-19 14:54:00,760 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:54:00,760 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:54:00,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:00,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:00,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:54:00,760 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:54:00,761 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,761 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:00,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:00,762 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,762 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:00,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:00,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:00,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:00,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:54:00,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cb33201[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:00,763 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:54:00,763 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,763 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,764 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:54:00,764 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:54:00,764 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,764 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:00,764 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:00,764 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:54:00,764 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,765 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:00,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:00,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:00,765 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:54:00,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:00,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:00,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:54:00,767 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:54:00,767 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:00,767 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:00,767 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,767 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:00,768 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,768 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,768 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:00,768 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,769 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:54:00,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:00,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:00,771 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:00,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:54:00,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:00,771 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:00,872 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:00,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:00,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:00,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:00,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,879 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:54:00,879 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:00,879 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:54:00,879 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:54:00,879 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,880 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,880 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:00,880 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:00,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:00,881 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:00,881 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,882 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,882 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:54:00,882 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:00,882 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:54:00,882 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:00,882 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:54:00,882 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:00,882 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:00,882 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:54:00,882 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. started... 2023-03-19 14:54:00,882 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4b7e555dc6c9decb145e8efe79d877a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:01,298 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078de6e92d75cd4df987013ec75b194c4a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509078de6e92d75cd4df987013ec75b194c4a 2023-03-19 14:54:01,704 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/6c11c7abe0f44004857e14a80cd7d42d 2023-03-19 14:54:01,708 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/6c11c7abe0f44004857e14a80cd7d42d as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6c11c7abe0f44004857e14a80cd7d42d 2023-03-19 14:54:01,713 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6c11c7abe0f44004857e14a80cd7d42d, entries=1, sequenceid=37, filesize=4.9 K 2023-03-19 14:54:01,713 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b7e555dc6c9decb145e8efe79d877a7 in 831ms, sequenceid=37, compaction requested=true 2023-03-19 14:54:01,714 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:54:01,714 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:54:01,714 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:01,714 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:01,714 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,714 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:54:01,714 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:54:01,715 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,715 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:01,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:01,715 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,715 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:01,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:01,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:01,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:01,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:54:01,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7973f5e8[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:01,716 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:54:01,716 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,717 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,717 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:54:01,717 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:54:01,717 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,717 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:01,717 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:01,718 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,718 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:01,718 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:01,718 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:01,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:54:01,719 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:54:01,719 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:01,719 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:01,719 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,719 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:01,720 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,720 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,720 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:01,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:01,721 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,722 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:01,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,723 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,723 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,723 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,723 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:01,723 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:01,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:01,723 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,723 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,723 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:01,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:54:01,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:01,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:54:01,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:01,723 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,724 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:01,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:01,724 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:01,724 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:01,824 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:01,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:01,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:01,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:01,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,831 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:54:01,831 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:01,831 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-19 14:54:01,831 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-19 14:54:01,831 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,831 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,832 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:01,832 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:01,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:01,832 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:01,832 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:01,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:01,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,833 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,833 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-19 14:54:01,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:01,833 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-19 14:54:01,833 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:01,833 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-19 14:54:01,833 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:01,833 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:01,833 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:54:01,833 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. started... 2023-03-19 14:54:01,833 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4b7e555dc6c9decb145e8efe79d877a7 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:02,245 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120cf40b5060a254f7ca432ab0dfce8746a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120cf40b5060a254f7ca432ab0dfce8746a 2023-03-19 14:54:02,650 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/6197bf384f3747f7904d255b3f2f3dee 2023-03-19 14:54:02,655 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/6197bf384f3747f7904d255b3f2f3dee as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6197bf384f3747f7904d255b3f2f3dee 2023-03-19 14:54:02,659 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6197bf384f3747f7904d255b3f2f3dee, entries=1, sequenceid=41, filesize=4.9 K 2023-03-19 14:54:02,660 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b7e555dc6c9decb145e8efe79d877a7 in 827ms, sequenceid=41, compaction requested=true 2023-03-19 14:54:02,660 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:54:02,660 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:54:02,660 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:02,660 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:02,660 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,660 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-19 14:54:02,660 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-19 14:54:02,661 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,661 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:02,662 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:02,662 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:02,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-19 14:54:02,663 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-19 14:54:02,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41c2e0c0[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:02,663 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,664 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,664 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-19 14:54:02,664 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,664 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:02,664 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-19 14:54:02,664 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:02,665 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,665 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-19 14:54:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:02,665 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:02,665 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-19 14:54:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:02,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:54:02,667 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-19 14:54:02,667 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:02,667 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:02,667 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,667 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:02,668 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,668 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:02,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,668 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,668 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:02,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,669 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:02,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,671 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,671 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,671 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,671 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:02,671 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:02,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:02,671 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:02,671 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:02,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:02,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-19 14:54:02,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-19 14:54:02,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:02,671 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,672 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,672 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:02,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:02,672 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:02,672 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:02,772 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:02,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:02,774 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-19 14:54:02,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:54:02,777 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:54:02,778 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:02,778 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238242778 2023-03-19 14:54:02,791 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:54:02,792 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-19 14:54:02,792 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:54:02,793 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x420512a0 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:54:02,796 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53b6622a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:54:02,797 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:54:03,636 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030b8e3bb83db048ce8a390bc6f78d9c15 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601030b8e3bb83db048ce8a390bc6f78d9c15 2023-03-19 14:54:03,637 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:54:03,654 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:54:03,655 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43952, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:54:03,662 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:54:03,663 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34894, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:54:03,673 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d9c34d7f18824fb5b77d8eea73f51ebd first=Optional[r3] last=Optional[r6] 2023-03-19 14:54:03,674 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d9c34d7f18824fb5b77d8eea73f51ebd}] 2023-03-19 14:54:03,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d9c34d7f18824fb5b77d8eea73f51ebd for inclusion in 4b7e555dc6c9decb145e8efe79d877a7/family1 2023-03-19 14:54:03,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-19 14:54:03,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:54:03,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:54:03,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d9c34d7f18824fb5b77d8eea73f51ebd to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l43efikaef9bmvt7n0842cgseej2cf0p8as09up0vcs4a6ph0rscano5b4kv5sk8/family1/d9c34d7f18824fb5b77d8eea73f51ebd 2023-03-19 14:54:03,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l43efikaef9bmvt7n0842cgseej2cf0p8as09up0vcs4a6ph0rscano5b4kv5sk8/family1/d9c34d7f18824fb5b77d8eea73f51ebd as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/c803a7eb627b4404bb533527539711e0_SeqId_44_ 2023-03-19 14:54:03,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l43efikaef9bmvt7n0842cgseej2cf0p8as09up0vcs4a6ph0rscano5b4kv5sk8/family1/d9c34d7f18824fb5b77d8eea73f51ebd into 4b7e555dc6c9decb145e8efe79d877a7/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/c803a7eb627b4404bb533527539711e0_SeqId_44_ - updating store file list. 2023-03-19 14:54:03,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/c803a7eb627b4404bb533527539711e0_SeqId_44_ into 4b7e555dc6c9decb145e8efe79d877a7/family1 2023-03-19 14:54:03,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l43efikaef9bmvt7n0842cgseej2cf0p8as09up0vcs4a6ph0rscano5b4kv5sk8/family1/d9c34d7f18824fb5b77d8eea73f51ebd into 4b7e555dc6c9decb145e8efe79d877a7/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/c803a7eb627b4404bb533527539711e0_SeqId_44_) 2023-03-19 14:54:03,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__l43efikaef9bmvt7n0842cgseej2cf0p8as09up0vcs4a6ph0rscano5b4kv5sk8/family1/d9c34d7f18824fb5b77d8eea73f51ebd 2023-03-19 14:54:03,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-19 14:54:03,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-19 14:54:03,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 4b7e555dc6c9decb145e8efe79d877a7/family1 is initiating minor compaction 2023-03-19 14:54:03,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@58663a0f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-19 14:54:03,698 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 4b7e555dc6c9decb145e8efe79d877a7/family1 in testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:54:03,698 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4e38ea87982747ac8d44c7a09fa5050f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/ad63ccdc3201478c8c65e62a31ae3427, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4656a6921a8148058955b85d0ac68163, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/29a88ccf6d854f259c64238859e6890a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1bf290c0467645d3bc0e50bf481f7a87, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/893def6e626942aeaba860c56d1c1b70, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/796b8c983f834cdfbcfebdb28cfe8efe, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6c11c7abe0f44004857e14a80cd7d42d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6197bf384f3747f7904d255b3f2f3dee, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/c803a7eb627b4404bb533527539711e0_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp, totalSize=50.0 K 2023-03-19 14:54:03,698 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 4e38ea87982747ac8d44c7a09fa5050f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-19 14:54:03,698 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting ad63ccdc3201478c8c65e62a31ae3427, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-19 14:54:03,698 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 4656a6921a8148058955b85d0ac68163, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-19 14:54:03,698 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 29a88ccf6d854f259c64238859e6890a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-19 14:54:03,699 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 1bf290c0467645d3bc0e50bf481f7a87, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-19 14:54:03,699 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 893def6e626942aeaba860c56d1c1b70, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-19 14:54:03,699 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 796b8c983f834cdfbcfebdb28cfe8efe, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-19 14:54:03,699 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 6c11c7abe0f44004857e14a80cd7d42d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-19 14:54:03,699 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 6197bf384f3747f7904d255b3f2f3dee, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-19 14:54:03,699 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting c803a7eb627b4404bb533527539711e0_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-19 14:54:03,707 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:54:03,709 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:03,711 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512282ed0c9a778ed42888df8c9e7556db507 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512282ed0c9a778ed42888df8c9e7556db507 2023-03-19 14:54:03,713 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c4dc6636370f4211bbe4490f20c8fb06 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c4dc6636370f4211bbe4490f20c8fb06 2023-03-19 14:54:03,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0c6011da15c4fbf9e7559658b02af3c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f0c6011da15c4fbf9e7559658b02af3c 2023-03-19 14:54:03,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103cbe04e7beaeb4658abdf916cb9ca4e4e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103cbe04e7beaeb4658abdf916cb9ca4e4e 2023-03-19 14:54:03,716 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-19 14:54:03,716 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-19 14:54:03,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:54:03,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:54:03,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:54:03,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:54:03,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:54:03,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:54:03,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:54:03,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:54:03,783 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] throttle.PressureAwareThroughputController(145): 4b7e555dc6c9decb145e8efe79d877a7#family1#compaction#49 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:54:04,217 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/1cc750ef463245ed8d4fff3ac3786220 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1cc750ef463245ed8d4fff3ac3786220 2023-03-19 14:54:04,232 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059ab0bba38e10407eae82d543c76dca0c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512059ab0bba38e10407eae82d543c76dca0c 2023-03-19 14:54:04,233 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:54:04,234 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4b7e555dc6c9decb145e8efe79d877a7/family1 of 4b7e555dc6c9decb145e8efe79d877a7 into 1cc750ef463245ed8d4fff3ac3786220(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:54:04,234 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:54:04,234 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1679237643698; duration=0sec 2023-03-19 14:54:04,234 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:04,261 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/35d16a050ae94eb8931f1add753234f2 first=Optional[r00] last=Optional[r2] 2023-03-19 14:54:04,262 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/35d16a050ae94eb8931f1add753234f2}] 2023-03-19 14:54:04,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/35d16a050ae94eb8931f1add753234f2 for inclusion in 4b7e555dc6c9decb145e8efe79d877a7/family1 2023-03-19 14:54:04,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-19 14:54:04,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:54:04,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:54:04,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/35d16a050ae94eb8931f1add753234f2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gudee9f344iv78ejpatp23vjglc5qfml0vic3m8s74qda69sdhdsarumerqgqnp4/family1/35d16a050ae94eb8931f1add753234f2 2023-03-19 14:54:04,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gudee9f344iv78ejpatp23vjglc5qfml0vic3m8s74qda69sdhdsarumerqgqnp4/family1/35d16a050ae94eb8931f1add753234f2 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/d30d0f53351f451692366415ca63319f_SeqId_47_ 2023-03-19 14:54:04,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4e38ea87982747ac8d44c7a09fa5050f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/ad63ccdc3201478c8c65e62a31ae3427, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4656a6921a8148058955b85d0ac68163, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/29a88ccf6d854f259c64238859e6890a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1bf290c0467645d3bc0e50bf481f7a87, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/893def6e626942aeaba860c56d1c1b70, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/796b8c983f834cdfbcfebdb28cfe8efe, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6c11c7abe0f44004857e14a80cd7d42d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6197bf384f3747f7904d255b3f2f3dee, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/c803a7eb627b4404bb533527539711e0_SeqId_44_] to archive 2023-03-19 14:54:04,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gudee9f344iv78ejpatp23vjglc5qfml0vic3m8s74qda69sdhdsarumerqgqnp4/family1/35d16a050ae94eb8931f1add753234f2 into 4b7e555dc6c9decb145e8efe79d877a7/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/d30d0f53351f451692366415ca63319f_SeqId_47_ - updating store file list. 2023-03-19 14:54:04,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:04,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4e38ea87982747ac8d44c7a09fa5050f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4e38ea87982747ac8d44c7a09fa5050f 2023-03-19 14:54:04,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/ad63ccdc3201478c8c65e62a31ae3427 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/ad63ccdc3201478c8c65e62a31ae3427 2023-03-19 14:54:04,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/d30d0f53351f451692366415ca63319f_SeqId_47_ into 4b7e555dc6c9decb145e8efe79d877a7/family1 2023-03-19 14:54:04,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gudee9f344iv78ejpatp23vjglc5qfml0vic3m8s74qda69sdhdsarumerqgqnp4/family1/35d16a050ae94eb8931f1add753234f2 into 4b7e555dc6c9decb145e8efe79d877a7/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/d30d0f53351f451692366415ca63319f_SeqId_47_) 2023-03-19 14:54:04,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyPolicy__gudee9f344iv78ejpatp23vjglc5qfml0vic3m8s74qda69sdhdsarumerqgqnp4/family1/35d16a050ae94eb8931f1add753234f2 2023-03-19 14:54:04,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-19 14:54:04,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4656a6921a8148058955b85d0ac68163 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/4656a6921a8148058955b85d0ac68163 2023-03-19 14:54:04,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-19 14:54:04,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 4b7e555dc6c9decb145e8efe79d877a7/family1 is initiating minor compaction (all files) 2023-03-19 14:54:04,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@43845a67; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:04,290 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4b7e555dc6c9decb145e8efe79d877a7/family1 in testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:54:04,290 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/e049a598f5c6470f8d51dae44764ebd0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1cc750ef463245ed8d4fff3ac3786220, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/d30d0f53351f451692366415ca63319f_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp, totalSize=337.0 K 2023-03-19 14:54:04,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/29a88ccf6d854f259c64238859e6890a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/29a88ccf6d854f259c64238859e6890a 2023-03-19 14:54:04,291 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting e049a598f5c6470f8d51dae44764ebd0, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878808483 2023-03-19 14:54:04,291 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 1cc750ef463245ed8d4fff3ac3786220, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621208483 2023-03-19 14:54:04,291 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting d30d0f53351f451692366415ca63319f_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878808483 2023-03-19 14:54:04,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1bf290c0467645d3bc0e50bf481f7a87 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1bf290c0467645d3bc0e50bf481f7a87 2023-03-19 14:54:04,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:54:04,293 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:04,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/893def6e626942aeaba860c56d1c1b70 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/893def6e626942aeaba860c56d1c1b70 2023-03-19 14:54:04,295 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130208d7c4f370f4fe5afe24faed572e0a2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130208d7c4f370f4fe5afe24faed572e0a2 2023-03-19 14:54:04,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/796b8c983f834cdfbcfebdb28cfe8efe to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/796b8c983f834cdfbcfebdb28cfe8efe 2023-03-19 14:54:04,297 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201e28c63c62d434918bd5e53ab97d2853b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201e28c63c62d434918bd5e53ab97d2853b 2023-03-19 14:54:04,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6c11c7abe0f44004857e14a80cd7d42d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6c11c7abe0f44004857e14a80cd7d42d 2023-03-19 14:54:04,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6197bf384f3747f7904d255b3f2f3dee to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/6197bf384f3747f7904d255b3f2f3dee 2023-03-19 14:54:04,299 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c49be9626a5646ba90c9e4a1c5191299 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c49be9626a5646ba90c9e4a1c5191299 2023-03-19 14:54:04,299 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-19 14:54:04,299 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-19 14:54:04,300 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-19 14:54:04,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-19 14:54:04,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:04,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/c803a7eb627b4404bb533527539711e0_SeqId_44_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/c803a7eb627b4404bb533527539711e0_SeqId_44_ 2023-03-19 14:54:04,302 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:54:04,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.5270 sec 2023-03-19 14:54:04,318 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4b7e555dc6c9decb145e8efe79d877a7#family1#compaction#50 average throughput is 11.90 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:54:04,404 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=253 (was 248) - Thread LEAK? -, OpenFileDescriptor=614 (was 586) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=259 (was 272), ProcessCount=168 (was 168), AvailableMemoryMB=4425 (was 4443) 2023-03-19 14:54:04,417 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=253, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=259, ProcessCount=168, AvailableMemoryMB=4425 2023-03-19 14:54:04,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-19 14:54:04,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:04,423 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:54:04,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-19 14:54:04,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-19 14:54:04,424 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:54:04,426 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:04,426 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38 empty. 2023-03-19 14:54:04,427 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:04,427 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-19 14:54:04,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-19 14:54:04,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-19 14:54:04,837 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-19 14:54:04,838 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => d7485b1a2967ecb08afbbe8485e3ef38, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:54:05,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-19 14:54:05,246 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:05,246 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing d7485b1a2967ecb08afbbe8485e3ef38, disabling compactions & flushes 2023-03-19 14:54:05,246 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:05,246 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:05,246 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. after waiting 0 ms 2023-03-19 14:54:05,246 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:05,246 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:05,246 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:05,251 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:54:05,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237645253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237645253"}]},"ts":"1679237645253"} 2023-03-19 14:54:05,255 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-19 14:54:05,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:54:05,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237645256"}]},"ts":"1679237645256"} 2023-03-19 14:54:05,257 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-19 14:54:05,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, ASSIGN}] 2023-03-19 14:54:05,261 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, ASSIGN 2023-03-19 14:54:05,262 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:54:05,414 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d7485b1a2967ecb08afbbe8485e3ef38, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:05,415 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237645414"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237645414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237645414"}]},"ts":"1679237645414"} 2023-03-19 14:54:05,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure d7485b1a2967ecb08afbbe8485e3ef38, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:05,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-19 14:54:05,544 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/.tmp/family1/d3848a106d0b4ca98836d99c8a2efdbb as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/d3848a106d0b4ca98836d99c8a2efdbb 2023-03-19 14:54:05,553 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4b7e555dc6c9decb145e8efe79d877a7/family1 of 4b7e555dc6c9decb145e8efe79d877a7 into d3848a106d0b4ca98836d99c8a2efdbb(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:54:05,553 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:54:05,553 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1679237644290; duration=1sec 2023-03-19 14:54:05,554 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:05,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/e049a598f5c6470f8d51dae44764ebd0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1cc750ef463245ed8d4fff3ac3786220, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/d30d0f53351f451692366415ca63319f_SeqId_47_] to archive 2023-03-19 14:54:05,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:05,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:05,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7485b1a2967ecb08afbbe8485e3ef38, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:54:05,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:05,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:05,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:05,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/e049a598f5c6470f8d51dae44764ebd0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/e049a598f5c6470f8d51dae44764ebd0 2023-03-19 14:54:05,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:05,582 INFO [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:05,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1cc750ef463245ed8d4fff3ac3786220 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/1cc750ef463245ed8d4fff3ac3786220 2023-03-19 14:54:05,584 DEBUG [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:05,584 DEBUG [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:05,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/d30d0f53351f451692366415ca63319f_SeqId_47_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/family1/d30d0f53351f451692366415ca63319f_SeqId_47_ 2023-03-19 14:54:05,585 INFO [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7485b1a2967ecb08afbbe8485e3ef38 columnFamilyName family1 2023-03-19 14:54:05,586 INFO [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] regionserver.HStore(310): Store=d7485b1a2967ecb08afbbe8485e3ef38/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:05,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:05,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:05,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:05,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:54:05,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d7485b1a2967ecb08afbbe8485e3ef38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62229044, jitterRate=-0.07271498441696167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:54:05,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:05,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38., pid=41, masterSystemTime=1679237645574 2023-03-19 14:54:05,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:05,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:05,600 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d7485b1a2967ecb08afbbe8485e3ef38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:05,600 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237645599"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237645599"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237645599"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237645599"}]},"ts":"1679237645599"} 2023-03-19 14:54:05,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-19 14:54:05,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure d7485b1a2967ecb08afbbe8485e3ef38, server=jenkins-hbase20.apache.org,33191,1679237584457 in 183 msec 2023-03-19 14:54:05,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-19 14:54:05,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, ASSIGN in 344 msec 2023-03-19 14:54:05,606 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:54:05,607 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237645607"}]},"ts":"1679237645607"} 2023-03-19 14:54:05,608 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-19 14:54:05,610 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:54:05,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1900 sec 2023-03-19 14:54:05,902 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-19 14:54:06,374 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:06,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-19 14:54:06,530 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-19 14:54:06,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:06,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:06,562 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:06,562 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:06,562 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-19 14:54:06,562 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-19 14:54:06,562 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:06,562 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:06,563 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:06,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:06,563 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:06,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:06,564 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:06,564 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:06,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:06,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:06,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:06,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:06,564 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:06,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:06,565 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-19 14:54:06,565 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:06,565 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-19 14:54:06,565 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:06,565 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:06,565 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:06,565 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. started... 2023-03-19 14:54:06,566 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d7485b1a2967ecb08afbbe8485e3ef38 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-19 14:54:07,011 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113008fbb4347d324b8185e4148e98f6cdd6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113008fbb4347d324b8185e4148e98f6cdd6 2023-03-19 14:54:07,415 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/424ec3827efe48c3bc1e647c346bf2f3 2023-03-19 14:54:07,421 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/424ec3827efe48c3bc1e647c346bf2f3 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/424ec3827efe48c3bc1e647c346bf2f3 2023-03-19 14:54:07,427 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/424ec3827efe48c3bc1e647c346bf2f3, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-19 14:54:07,428 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d7485b1a2967ecb08afbbe8485e3ef38 in 863ms, sequenceid=5, compaction requested=false 2023-03-19 14:54:07,429 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:07,429 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:07,429 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:07,429 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:07,429 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,429 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-19 14:54:07,429 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-19 14:54:07,430 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,431 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:07,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:07,431 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,431 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:07,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:07,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-19 14:54:07,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c6220ec[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:07,433 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-19 14:54:07,433 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,434 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,434 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-19 14:54:07,434 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-19 14:54:07,435 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:07,435 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,435 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:07,436 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-19 14:54:07,436 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:07,436 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,436 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-19 14:54:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:07,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-19 14:54:07,438 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-19 14:54:07,438 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:07,438 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:07,438 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,438 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:07,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:07,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:07,439 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:07,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:07,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:07,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,441 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:07,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,442 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,442 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:07,442 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,442 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:07,442 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,442 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:07,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:07,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:07,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:07,442 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:07,442 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,442 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,442 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,442 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:07,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:07,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:07,443 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:07,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-19 14:54:07,543 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:07,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:07,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:07,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:07,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,557 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:07,557 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:07,557 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-19 14:54:07,557 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-19 14:54:07,558 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,558 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,559 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:07,559 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:07,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:07,560 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:07,560 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:07,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:07,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,562 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,562 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-19 14:54:07,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:07,562 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-19 14:54:07,562 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:07,562 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-19 14:54:07,563 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:07,563 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:07,563 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:07,563 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. started... 2023-03-19 14:54:07,563 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d7485b1a2967ecb08afbbe8485e3ef38 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-19 14:54:07,983 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d3c0c1a71db94c73ad6bcb40555e6458 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d3c0c1a71db94c73ad6bcb40555e6458 2023-03-19 14:54:08,391 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/759c0c9455da4283ba1d3e8a5ca07e52 2023-03-19 14:54:08,404 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/759c0c9455da4283ba1d3e8a5ca07e52 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/759c0c9455da4283ba1d3e8a5ca07e52 2023-03-19 14:54:08,409 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/759c0c9455da4283ba1d3e8a5ca07e52, entries=1, sequenceid=9, filesize=5.0 K 2023-03-19 14:54:08,410 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d7485b1a2967ecb08afbbe8485e3ef38 in 847ms, sequenceid=9, compaction requested=false 2023-03-19 14:54:08,410 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:08,410 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:08,411 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:08,411 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:08,411 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,411 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-19 14:54:08,411 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-19 14:54:08,412 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,412 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:08,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:08,413 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,413 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:08,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:08,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-19 14:54:08,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9542a5b[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:08,415 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-19 14:54:08,415 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,415 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,416 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-19 14:54:08,416 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-19 14:54:08,416 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:08,416 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,416 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:08,417 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,417 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-19 14:54:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:08,417 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:08,417 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-19 14:54:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:08,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:08,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-19 14:54:08,419 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-19 14:54:08,419 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:08,419 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:08,419 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,419 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:08,420 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,420 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,420 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:08,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:08,421 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:08,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,422 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:08,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:08,425 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:08,425 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,425 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:08,525 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:08,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:08,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:08,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:08,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,540 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:08,540 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:08,540 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-19 14:54:08,540 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-19 14:54:08,542 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,542 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,543 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,543 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:08,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:08,543 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:08,543 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,545 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,545 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-19 14:54:08,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:08,545 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-19 14:54:08,545 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:08,545 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-19 14:54:08,545 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:08,545 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:08,545 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:08,545 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. started... 2023-03-19 14:54:08,546 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d7485b1a2967ecb08afbbe8485e3ef38 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:08,966 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015a625fcf034849d7952fa7db3a8d0197 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512015a625fcf034849d7952fa7db3a8d0197 2023-03-19 14:54:09,376 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/2ce8b1cfe2954821b53c011d08ddbf9e 2023-03-19 14:54:09,388 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/2ce8b1cfe2954821b53c011d08ddbf9e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/2ce8b1cfe2954821b53c011d08ddbf9e 2023-03-19 14:54:09,396 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/2ce8b1cfe2954821b53c011d08ddbf9e, entries=1, sequenceid=13, filesize=5.0 K 2023-03-19 14:54:09,397 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d7485b1a2967ecb08afbbe8485e3ef38 in 852ms, sequenceid=13, compaction requested=true 2023-03-19 14:54:09,397 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:09,397 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:09,397 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:09,397 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:09,397 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,397 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-19 14:54:09,397 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-19 14:54:09,399 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,399 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:09,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:09,399 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,400 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:09,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:09,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:09,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-19 14:54:09,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f6e522c[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:09,402 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-19 14:54:09,402 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,403 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,403 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-19 14:54:09,403 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-19 14:54:09,403 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:09,403 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,403 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:09,404 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-19 14:54:09,404 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,404 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:09,405 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-19 14:54:09,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:09,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:09,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:09,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:09,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-19 14:54:09,408 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-19 14:54:09,408 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:09,408 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:09,408 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,408 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:09,410 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,410 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:09,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:09,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,410 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:09,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:09,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:09,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:09,411 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:09,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,412 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:09,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,414 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,414 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,414 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:09,414 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,414 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,414 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,414 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,414 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:09,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:09,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-19 14:54:09,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:09,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:09,414 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:09,414 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:09,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:09,415 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:09,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:09,415 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:09,515 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:09,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:09,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:09,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:09,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,522 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:09,522 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:09,522 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-19 14:54:09,522 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-19 14:54:09,523 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,523 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,524 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,524 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:09,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:09,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:09,524 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:09,524 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:09,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,525 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,525 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-19 14:54:09,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:09,525 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-19 14:54:09,526 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:09,526 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-19 14:54:09,526 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:09,526 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:09,526 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:09,526 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. started... 2023-03-19 14:54:09,526 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d7485b1a2967ecb08afbbe8485e3ef38 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:09,948 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052faa94a48576453499ab0ee66f569281 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512052faa94a48576453499ab0ee66f569281 2023-03-19 14:54:10,356 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/e03214508e82441ab74c266a18cc76bf 2023-03-19 14:54:10,363 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/e03214508e82441ab74c266a18cc76bf as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e03214508e82441ab74c266a18cc76bf 2023-03-19 14:54:10,369 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e03214508e82441ab74c266a18cc76bf, entries=1, sequenceid=17, filesize=5.0 K 2023-03-19 14:54:10,370 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d7485b1a2967ecb08afbbe8485e3ef38 in 844ms, sequenceid=17, compaction requested=true 2023-03-19 14:54:10,370 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:10,370 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:10,370 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:10,371 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:10,371 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,371 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-19 14:54:10,371 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-19 14:54:10,372 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,372 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:10,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:10,373 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,373 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:10,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:10,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:10,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-19 14:54:10,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@397c7be1[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:10,375 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-19 14:54:10,375 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,376 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,376 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-19 14:54:10,376 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-19 14:54:10,376 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:10,376 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,376 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:10,377 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-19 14:54:10,377 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,377 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:10,377 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-19 14:54:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:10,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:10,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:10,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-19 14:54:10,380 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-19 14:54:10,381 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:10,381 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:10,381 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,381 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:10,385 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,385 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:10,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,385 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:10,386 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,387 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,389 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,389 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:10,389 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:10,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:10,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-19 14:54:10,389 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,389 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:10,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:10,389 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:10,389 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:10,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:10,389 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,390 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:10,390 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,390 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,390 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:10,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:10,490 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:10,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:10,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:10,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:10,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,505 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:10,505 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:10,505 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-19 14:54:10,505 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-19 14:54:10,506 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,506 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,508 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:10,508 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:10,509 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:10,509 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,511 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,511 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-19 14:54:10,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:10,511 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-19 14:54:10,511 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:10,512 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-19 14:54:10,512 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:10,512 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:10,512 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:10,512 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. started... 2023-03-19 14:54:10,512 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d7485b1a2967ecb08afbbe8485e3ef38 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:10,937 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283820f55755fb461782b5f3d5d0f94813 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512283820f55755fb461782b5f3d5d0f94813 2023-03-19 14:54:11,108 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:54:11,345 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/0ff19ed3fcb140a685f2b8bf3b4f4d80 2023-03-19 14:54:11,351 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/0ff19ed3fcb140a685f2b8bf3b4f4d80 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/0ff19ed3fcb140a685f2b8bf3b4f4d80 2023-03-19 14:54:11,356 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/0ff19ed3fcb140a685f2b8bf3b4f4d80, entries=1, sequenceid=21, filesize=5.0 K 2023-03-19 14:54:11,357 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d7485b1a2967ecb08afbbe8485e3ef38 in 845ms, sequenceid=21, compaction requested=true 2023-03-19 14:54:11,357 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:11,357 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:11,357 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:11,358 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:11,358 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,358 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-19 14:54:11,358 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-19 14:54:11,359 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,359 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:11,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:11,359 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,359 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:11,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:11,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:11,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-19 14:54:11,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34944962[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:11,360 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-19 14:54:11,360 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,361 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,361 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-19 14:54:11,361 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-19 14:54:11,361 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:11,361 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,361 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:11,361 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,361 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-19 14:54:11,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:11,362 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:11,362 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-19 14:54:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:11,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:11,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-19 14:54:11,364 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-19 14:54:11,364 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:11,364 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:11,364 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,364 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:11,365 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,365 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,365 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:11,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:11,365 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:11,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:11,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,366 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:11,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:11,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:11,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-19 14:54:11,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:11,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:11,368 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:11,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,368 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,468 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:11,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:11,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:11,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:11,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,476 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:11,476 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:11,476 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-19 14:54:11,476 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-19 14:54:11,477 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,477 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,478 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:11,478 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:11,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:11,479 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:11,479 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:11,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,481 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,481 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-19 14:54:11,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:11,481 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-19 14:54:11,481 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:11,481 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-19 14:54:11,482 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:11,482 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:11,482 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:11,482 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. started... 2023-03-19 14:54:11,482 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d7485b1a2967ecb08afbbe8485e3ef38 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:11,906 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cd86a969268b46428a627a236ea09913 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231cd86a969268b46428a627a236ea09913 2023-03-19 14:54:12,315 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/e033bed5c6c94e8aaedf00c542e82f4a 2023-03-19 14:54:12,319 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/e033bed5c6c94e8aaedf00c542e82f4a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e033bed5c6c94e8aaedf00c542e82f4a 2023-03-19 14:54:12,324 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e033bed5c6c94e8aaedf00c542e82f4a, entries=1, sequenceid=25, filesize=5.0 K 2023-03-19 14:54:12,324 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d7485b1a2967ecb08afbbe8485e3ef38 in 842ms, sequenceid=25, compaction requested=true 2023-03-19 14:54:12,325 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:12,325 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:12,325 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:12,325 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:12,325 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,325 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-19 14:54:12,325 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-19 14:54:12,326 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,326 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:12,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:12,327 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,327 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:12,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-19 14:54:12,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cbabb59[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:12,328 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-19 14:54:12,328 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,329 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,329 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-19 14:54:12,329 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,329 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:12,329 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-19 14:54:12,329 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:12,330 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,330 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-19 14:54:12,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:12,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:12,330 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:12,330 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-19 14:54:12,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:12,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:12,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-19 14:54:12,332 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-19 14:54:12,332 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:12,332 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:12,332 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,332 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:12,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:12,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:12,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:12,333 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,334 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,335 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,335 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,335 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:12,335 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,336 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:12,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-19 14:54:12,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:12,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:12,336 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:12,336 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:12,336 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,336 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,336 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:12,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:12,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:12,336 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,336 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:12,436 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:12,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:12,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:12,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:12,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,443 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:12,443 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:12,443 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-19 14:54:12,443 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-19 14:54:12,443 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,443 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,444 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,444 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:12,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:12,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:12,444 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,445 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:12,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:12,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-19 14:54:12,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,445 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-19 14:54:12,445 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:12,446 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-19 14:54:12,446 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:12,446 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:12,446 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:12,446 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. started... 2023-03-19 14:54:12,446 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d7485b1a2967ecb08afbbe8485e3ef38 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:12,863 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e693f4b976d24d15a017e60f4dd89302 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101e693f4b976d24d15a017e60f4dd89302 2023-03-19 14:54:12,867 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/75dd7fab709a40f9ba5d4a9d2f2a2f34 2023-03-19 14:54:12,872 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/75dd7fab709a40f9ba5d4a9d2f2a2f34 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/75dd7fab709a40f9ba5d4a9d2f2a2f34 2023-03-19 14:54:12,877 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/75dd7fab709a40f9ba5d4a9d2f2a2f34, entries=1, sequenceid=29, filesize=5.0 K 2023-03-19 14:54:12,878 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d7485b1a2967ecb08afbbe8485e3ef38 in 432ms, sequenceid=29, compaction requested=true 2023-03-19 14:54:12,878 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:12,878 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:12,878 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:12,878 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:12,878 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,878 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-19 14:54:12,878 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-19 14:54:12,879 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,879 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:12,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:12,880 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,880 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:12,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:12,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:12,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:12,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-19 14:54:12,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15875d0[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:12,881 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-19 14:54:12,881 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,882 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,882 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-19 14:54:12,882 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-19 14:54:12,882 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:12,882 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,882 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:12,883 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-19 14:54:12,883 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,883 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:12,883 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-19 14:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:12,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-19 14:54:12,885 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-19 14:54:12,885 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:12,885 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:12,885 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,885 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:12,886 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,886 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,886 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:12,886 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:12,887 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,889 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:12,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:12,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:12,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:12,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:12,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:12,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:12,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:12,889 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:12,990 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:12,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:13,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:13,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:13,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,017 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:13,017 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:13,017 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-19 14:54:13,017 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-19 14:54:13,017 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,017 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,019 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:13,019 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:13,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:13,019 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,019 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:13,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:13,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,020 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,021 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-19 14:54:13,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,021 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-19 14:54:13,021 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:13,021 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-19 14:54:13,022 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:13,022 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:13,022 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:13,022 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. started... 2023-03-19 14:54:13,022 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d7485b1a2967ecb08afbbe8485e3ef38 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:13,437 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010344c6666f7c6145609ab4a659dbdf6101 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010344c6666f7c6145609ab4a659dbdf6101 2023-03-19 14:54:13,843 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/1c05f7188f0b4f90b76be3b25d977806 2023-03-19 14:54:13,848 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/1c05f7188f0b4f90b76be3b25d977806 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1c05f7188f0b4f90b76be3b25d977806 2023-03-19 14:54:13,851 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1c05f7188f0b4f90b76be3b25d977806, entries=1, sequenceid=33, filesize=5.0 K 2023-03-19 14:54:13,852 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d7485b1a2967ecb08afbbe8485e3ef38 in 830ms, sequenceid=33, compaction requested=true 2023-03-19 14:54:13,852 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:13,852 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:13,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:13,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:13,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-19 14:54:13,852 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-19 14:54:13,853 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,853 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:13,854 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,854 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:13,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-19 14:54:13,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ba1a569[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:13,855 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-19 14:54:13,855 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,856 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,856 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-19 14:54:13,856 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-19 14:54:13,856 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,856 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:13,856 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:13,857 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-19 14:54:13,857 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,857 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:13,857 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-19 14:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:13,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-19 14:54:13,858 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-19 14:54:13,859 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:13,859 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:13,859 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,859 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:13,859 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,859 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,859 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:13,860 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:13,861 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:13,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:13,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,862 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:13,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:13,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:13,862 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:13,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:13,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-19 14:54:13,963 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:13,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:13,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:13,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:13,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,974 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:13,974 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:13,974 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-19 14:54:13,974 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-19 14:54:13,975 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,975 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,985 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:13,985 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:13,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:13,985 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:13,985 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:13,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:13,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,986 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,986 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-19 14:54:13,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:13,986 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-19 14:54:13,986 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:13,986 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-19 14:54:13,986 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:13,987 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:13,987 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:13,987 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. started... 2023-03-19 14:54:13,987 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d7485b1a2967ecb08afbbe8485e3ef38 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:14,415 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070f21ab8bd7ec43aaaf418194dd6d7ff6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509070f21ab8bd7ec43aaaf418194dd6d7ff6 2023-03-19 14:54:14,824 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/56e8db484633469aa5f3cc65900ca4af 2023-03-19 14:54:14,837 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/56e8db484633469aa5f3cc65900ca4af as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/56e8db484633469aa5f3cc65900ca4af 2023-03-19 14:54:14,844 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/56e8db484633469aa5f3cc65900ca4af, entries=1, sequenceid=37, filesize=5.0 K 2023-03-19 14:54:14,844 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d7485b1a2967ecb08afbbe8485e3ef38 in 857ms, sequenceid=37, compaction requested=true 2023-03-19 14:54:14,844 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:14,845 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:14,845 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:14,845 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:14,845 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,845 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-19 14:54:14,845 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-19 14:54:14,846 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,846 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:14,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:14,847 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,847 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:14,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-19 14:54:14,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4de82826[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:14,849 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-19 14:54:14,849 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,850 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,850 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-19 14:54:14,850 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-19 14:54:14,850 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,850 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:14,850 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:14,851 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,851 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-19 14:54:14,851 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:14,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:14,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:14,851 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-19 14:54:14,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:14,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:14,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:14,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:14,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-19 14:54:14,855 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-19 14:54:14,855 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:14,855 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:14,855 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,855 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:14,857 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,857 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:14,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,857 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:14,858 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,859 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:14,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,862 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:14,863 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:14,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-19 14:54:14,863 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:14,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:14,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:14,863 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:14,863 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,863 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,863 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:14,863 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:14,863 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,864 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:14,864 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,964 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:14,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:14,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:14,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:14,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,977 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:14,977 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:14,977 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-19 14:54:14,977 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-19 14:54:14,978 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,978 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,979 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,979 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:14,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:14,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:14,979 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:14,979 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:14,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:14,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,981 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,981 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-19 14:54:14,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:14,981 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-19 14:54:14,981 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:14,981 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-19 14:54:14,982 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:14,982 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:14,982 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:14,982 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. started... 2023-03-19 14:54:14,982 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d7485b1a2967ecb08afbbe8485e3ef38 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:15,396 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c333a97fea8a4c56ab07bde9dfb8ac7e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c333a97fea8a4c56ab07bde9dfb8ac7e 2023-03-19 14:54:15,801 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/cfc0c710cf6148a6b765da4c9669ecca 2023-03-19 14:54:15,807 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/cfc0c710cf6148a6b765da4c9669ecca as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/cfc0c710cf6148a6b765da4c9669ecca 2023-03-19 14:54:15,811 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/cfc0c710cf6148a6b765da4c9669ecca, entries=1, sequenceid=41, filesize=5.0 K 2023-03-19 14:54:15,812 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d7485b1a2967ecb08afbbe8485e3ef38 in 830ms, sequenceid=41, compaction requested=true 2023-03-19 14:54:15,812 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:15,812 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:15,812 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:15,812 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:15,812 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,812 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-19 14:54:15,812 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-19 14:54:15,813 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,813 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:15,814 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,814 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:15,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-19 14:54:15,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44122b1[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:15,815 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-19 14:54:15,815 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,815 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,816 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-19 14:54:15,816 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,816 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:15,816 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-19 14:54:15,816 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:15,816 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-19 14:54:15,817 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,817 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:15,817 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-19 14:54:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:15,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:15,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:15,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-19 14:54:15,819 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-19 14:54:15,819 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:15,819 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:15,819 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,819 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:15,820 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,820 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:15,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:15,820 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:15,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:15,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:15,821 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,821 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:15,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,823 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,823 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:15,823 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:15,823 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,823 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:15,823 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:15,823 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:15,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-19 14:54:15,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:15,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:15,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-19 14:54:15,823 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,824 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:15,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:15,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:15,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,824 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:15,924 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:15,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:15,926 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:15,927 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-19 14:54:15,928 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-19 14:54:15,929 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:15,929 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238255929 2023-03-19 14:54:15,931 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:54:15,931 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-19 14:54:15,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:15,932 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x1eb1812a to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:54:15,935 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788707c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:54:15,935 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:16,799 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fb29b67d94d64a3fac57ef4a136aef3a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb29b67d94d64a3fac57ef4a136aef3a 2023-03-19 14:54:16,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:16,813 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:54:16,814 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36606, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:54:16,823 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:54:16,825 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:54:16,835 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/aaa612796fed431291d1cfe11dfdc3f0 first=Optional[r3] last=Optional[r6] 2023-03-19 14:54:16,836 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/aaa612796fed431291d1cfe11dfdc3f0}] 2023-03-19 14:54:16,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/aaa612796fed431291d1cfe11dfdc3f0 for inclusion in d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:16,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-19 14:54:16,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:54:16,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:16,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/aaa612796fed431291d1cfe11dfdc3f0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ahk46heroj2rgk71v5rqhmf8ffs6cdc4o96570ligekt3kn19fhr63id4p6v55qm/family1/aaa612796fed431291d1cfe11dfdc3f0 2023-03-19 14:54:16,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ahk46heroj2rgk71v5rqhmf8ffs6cdc4o96570ligekt3kn19fhr63id4p6v55qm/family1/aaa612796fed431291d1cfe11dfdc3f0 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1fdd3354de594562bd1c0af544b1f86a_SeqId_44_ 2023-03-19 14:54:16,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ahk46heroj2rgk71v5rqhmf8ffs6cdc4o96570ligekt3kn19fhr63id4p6v55qm/family1/aaa612796fed431291d1cfe11dfdc3f0 into d7485b1a2967ecb08afbbe8485e3ef38/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1fdd3354de594562bd1c0af544b1f86a_SeqId_44_ - updating store file list. 2023-03-19 14:54:16,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1fdd3354de594562bd1c0af544b1f86a_SeqId_44_ into d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:16,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ahk46heroj2rgk71v5rqhmf8ffs6cdc4o96570ligekt3kn19fhr63id4p6v55qm/family1/aaa612796fed431291d1cfe11dfdc3f0 into d7485b1a2967ecb08afbbe8485e3ef38/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1fdd3354de594562bd1c0af544b1f86a_SeqId_44_) 2023-03-19 14:54:16,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ahk46heroj2rgk71v5rqhmf8ffs6cdc4o96570ligekt3kn19fhr63id4p6v55qm/family1/aaa612796fed431291d1cfe11dfdc3f0 2023-03-19 14:54:16,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-19 14:54:16,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-19 14:54:16,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): d7485b1a2967ecb08afbbe8485e3ef38/family1 is initiating minor compaction 2023-03-19 14:54:16,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@748dec52; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:16,860 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d7485b1a2967ecb08afbbe8485e3ef38/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:16,861 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/759c0c9455da4283ba1d3e8a5ca07e52, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/2ce8b1cfe2954821b53c011d08ddbf9e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e03214508e82441ab74c266a18cc76bf, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/0ff19ed3fcb140a685f2b8bf3b4f4d80, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e033bed5c6c94e8aaedf00c542e82f4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/75dd7fab709a40f9ba5d4a9d2f2a2f34, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1c05f7188f0b4f90b76be3b25d977806, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/56e8db484633469aa5f3cc65900ca4af, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/cfc0c710cf6148a6b765da4c9669ecca, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1fdd3354de594562bd1c0af544b1f86a_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp, totalSize=50.4 K 2023-03-19 14:54:16,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 759c0c9455da4283ba1d3e8a5ca07e52, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-19 14:54:16,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 2ce8b1cfe2954821b53c011d08ddbf9e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-19 14:54:16,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting e03214508e82441ab74c266a18cc76bf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-19 14:54:16,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 0ff19ed3fcb140a685f2b8bf3b4f4d80, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-19 14:54:16,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting e033bed5c6c94e8aaedf00c542e82f4a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-19 14:54:16,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 75dd7fab709a40f9ba5d4a9d2f2a2f34, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-19 14:54:16,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 1c05f7188f0b4f90b76be3b25d977806, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-19 14:54:16,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 56e8db484633469aa5f3cc65900ca4af, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-19 14:54:16,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting cfc0c710cf6148a6b765da4c9669ecca, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-19 14:54:16,861 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 1fdd3354de594562bd1c0af544b1f86a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-19 14:54:16,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:16,863 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:16,864 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512283820f55755fb461782b5f3d5d0f94813 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512283820f55755fb461782b5f3d5d0f94813 2023-03-19 14:54:16,865 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231cd86a969268b46428a627a236ea09913 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231cd86a969268b46428a627a236ea09913 2023-03-19 14:54:16,866 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101e693f4b976d24d15a017e60f4dd89302 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101e693f4b976d24d15a017e60f4dd89302 2023-03-19 14:54:16,867 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010344c6666f7c6145609ab4a659dbdf6101 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010344c6666f7c6145609ab4a659dbdf6101 2023-03-19 14:54:16,867 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-19 14:54:16,867 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-19 14:54:16,867 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:16,867 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:16,908 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): d7485b1a2967ecb08afbbe8485e3ef38#family1#compaction#61 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:54:16,948 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/deeefd34e93b4958b8579a3d994d33bf as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/deeefd34e93b4958b8579a3d994d33bf 2023-03-19 14:54:16,952 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d7485b1a2967ecb08afbbe8485e3ef38/family1 of d7485b1a2967ecb08afbbe8485e3ef38 into deeefd34e93b4958b8579a3d994d33bf(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:54:16,952 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:16,953 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1679237656860; duration=0sec 2023-03-19 14:54:16,953 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:16,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/759c0c9455da4283ba1d3e8a5ca07e52, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/2ce8b1cfe2954821b53c011d08ddbf9e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e03214508e82441ab74c266a18cc76bf, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/0ff19ed3fcb140a685f2b8bf3b4f4d80, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e033bed5c6c94e8aaedf00c542e82f4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/75dd7fab709a40f9ba5d4a9d2f2a2f34, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1c05f7188f0b4f90b76be3b25d977806, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/56e8db484633469aa5f3cc65900ca4af, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/cfc0c710cf6148a6b765da4c9669ecca, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1fdd3354de594562bd1c0af544b1f86a_SeqId_44_] to archive 2023-03-19 14:54:16,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:16,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/759c0c9455da4283ba1d3e8a5ca07e52 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/759c0c9455da4283ba1d3e8a5ca07e52 2023-03-19 14:54:16,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/2ce8b1cfe2954821b53c011d08ddbf9e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/2ce8b1cfe2954821b53c011d08ddbf9e 2023-03-19 14:54:16,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e03214508e82441ab74c266a18cc76bf to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e03214508e82441ab74c266a18cc76bf 2023-03-19 14:54:16,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/0ff19ed3fcb140a685f2b8bf3b4f4d80 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/0ff19ed3fcb140a685f2b8bf3b4f4d80 2023-03-19 14:54:16,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e033bed5c6c94e8aaedf00c542e82f4a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/e033bed5c6c94e8aaedf00c542e82f4a 2023-03-19 14:54:17,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/75dd7fab709a40f9ba5d4a9d2f2a2f34 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/75dd7fab709a40f9ba5d4a9d2f2a2f34 2023-03-19 14:54:17,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1c05f7188f0b4f90b76be3b25d977806 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1c05f7188f0b4f90b76be3b25d977806 2023-03-19 14:54:17,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/56e8db484633469aa5f3cc65900ca4af to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/56e8db484633469aa5f3cc65900ca4af 2023-03-19 14:54:17,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/cfc0c710cf6148a6b765da4c9669ecca to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/cfc0c710cf6148a6b765da4c9669ecca 2023-03-19 14:54:17,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1fdd3354de594562bd1c0af544b1f86a_SeqId_44_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/1fdd3354de594562bd1c0af544b1f86a_SeqId_44_ 2023-03-19 14:54:17,755 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fde40b0fbb784e0a8f96b5aa88050d77 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fde40b0fbb784e0a8f96b5aa88050d77 2023-03-19 14:54:17,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:17,778 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b4d06ff57f8545bbb633c57922b5b43d first=Optional[r00] last=Optional[r2] 2023-03-19 14:54:17,779 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b4d06ff57f8545bbb633c57922b5b43d}] 2023-03-19 14:54:17,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b4d06ff57f8545bbb633c57922b5b43d for inclusion in d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:17,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-19 14:54:17,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:54:17,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:17,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/b4d06ff57f8545bbb633c57922b5b43d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__s52db925rj3nn78dno6q6hrn0dfj2va15fnt4pkdmuj53kt5he5f4jvjhro4nv1s/family1/b4d06ff57f8545bbb633c57922b5b43d 2023-03-19 14:54:17,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__s52db925rj3nn78dno6q6hrn0dfj2va15fnt4pkdmuj53kt5he5f4jvjhro4nv1s/family1/b4d06ff57f8545bbb633c57922b5b43d as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/8ae4d88f604344ae994844bbfeb731b7_SeqId_47_ 2023-03-19 14:54:17,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__s52db925rj3nn78dno6q6hrn0dfj2va15fnt4pkdmuj53kt5he5f4jvjhro4nv1s/family1/b4d06ff57f8545bbb633c57922b5b43d into d7485b1a2967ecb08afbbe8485e3ef38/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/8ae4d88f604344ae994844bbfeb731b7_SeqId_47_ - updating store file list. 2023-03-19 14:54:17,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/8ae4d88f604344ae994844bbfeb731b7_SeqId_47_ into d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:17,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__s52db925rj3nn78dno6q6hrn0dfj2va15fnt4pkdmuj53kt5he5f4jvjhro4nv1s/family1/b4d06ff57f8545bbb633c57922b5b43d into d7485b1a2967ecb08afbbe8485e3ef38/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/8ae4d88f604344ae994844bbfeb731b7_SeqId_47_) 2023-03-19 14:54:17,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__s52db925rj3nn78dno6q6hrn0dfj2va15fnt4pkdmuj53kt5he5f4jvjhro4nv1s/family1/b4d06ff57f8545bbb633c57922b5b43d 2023-03-19 14:54:17,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-19 14:54:17,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-19 14:54:17,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): d7485b1a2967ecb08afbbe8485e3ef38/family1 is initiating minor compaction (all files) 2023-03-19 14:54:17,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@402d16a1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:17,792 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d7485b1a2967ecb08afbbe8485e3ef38/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:17,793 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/424ec3827efe48c3bc1e647c346bf2f3, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/deeefd34e93b4958b8579a3d994d33bf, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/8ae4d88f604344ae994844bbfeb731b7_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp, totalSize=390.1 K 2023-03-19 14:54:17,793 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 424ec3827efe48c3bc1e647c346bf2f3, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878808483 2023-03-19 14:54:17,794 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting deeefd34e93b4958b8579a3d994d33bf, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621208483 2023-03-19 14:54:17,794 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 8ae4d88f604344ae994844bbfeb731b7_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878808483 2023-03-19 14:54:17,795 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:17,795 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:17,797 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113008fbb4347d324b8185e4148e98f6cdd6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113008fbb4347d324b8185e4148e98f6cdd6 2023-03-19 14:54:17,799 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512015a625fcf034849d7952fa7db3a8d0197 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512015a625fcf034849d7952fa7db3a8d0197 2023-03-19 14:54:17,800 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512052faa94a48576453499ab0ee66f569281 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512052faa94a48576453499ab0ee66f569281 2023-03-19 14:54:17,800 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-19 14:54:17,801 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-19 14:54:17,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:17,801 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:17,801 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:17,802 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-19 14:54:17,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8750 sec 2023-03-19 14:54:17,815 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): d7485b1a2967ecb08afbbe8485e3ef38#family1#compaction#62 average throughput is 16.42 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:54:17,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-19 14:54:17,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:18,291 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-19 14:54:18,293 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-19 14:54:18,293 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-19 14:54:18,296 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-19 14:54:18,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, REOPEN/MOVE}] 2023-03-19 14:54:18,300 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, REOPEN/MOVE 2023-03-19 14:54:18,300 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d7485b1a2967ecb08afbbe8485e3ef38, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:18,300 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237658300"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237658300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237658300"}]},"ts":"1679237658300"} 2023-03-19 14:54:18,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure d7485b1a2967ecb08afbbe8485e3ef38, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:18,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:18,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d7485b1a2967ecb08afbbe8485e3ef38, disabling compactions & flushes 2023-03-19 14:54:18,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:19,033 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/.tmp/family1/33e52483be504f36aab6efe22c7bd514 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/33e52483be504f36aab6efe22c7bd514 2023-03-19 14:54:19,043 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d7485b1a2967ecb08afbbe8485e3ef38/family1 of d7485b1a2967ecb08afbbe8485e3ef38 into 33e52483be504f36aab6efe22c7bd514(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:54:19,043 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:19,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:19,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:19,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. after waiting 0 ms 2023-03-19 14:54:19,043 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1679237657792; duration=1sec 2023-03-19 14:54:19,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:19,043 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:19,045 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/424ec3827efe48c3bc1e647c346bf2f3, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/deeefd34e93b4958b8579a3d994d33bf, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/8ae4d88f604344ae994844bbfeb731b7_SeqId_47_] to archive 2023-03-19 14:54:19,046 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:19,048 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/424ec3827efe48c3bc1e647c346bf2f3 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/424ec3827efe48c3bc1e647c346bf2f3 2023-03-19 14:54:19,050 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/deeefd34e93b4958b8579a3d994d33bf to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/deeefd34e93b4958b8579a3d994d33bf 2023-03-19 14:54:19,051 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/8ae4d88f604344ae994844bbfeb731b7_SeqId_47_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/8ae4d88f604344ae994844bbfeb731b7_SeqId_47_ 2023-03-19 14:54:19,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-19 14:54:19,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:19,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:19,060 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: d7485b1a2967ecb08afbbe8485e3ef38 to self. 2023-03-19 14:54:19,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:19,062 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d7485b1a2967ecb08afbbe8485e3ef38, regionState=CLOSED 2023-03-19 14:54:19,062 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237659062"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237659062"}]},"ts":"1679237659062"} 2023-03-19 14:54:19,065 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-19 14:54:19,065 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure d7485b1a2967ecb08afbbe8485e3ef38, server=jenkins-hbase20.apache.org,33191,1679237584457 in 761 msec 2023-03-19 14:54:19,066 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=true 2023-03-19 14:54:19,216 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d7485b1a2967ecb08afbbe8485e3ef38, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:19,216 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237659216"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237659216"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237659216"}]},"ts":"1679237659216"} 2023-03-19 14:54:19,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure d7485b1a2967ecb08afbbe8485e3ef38, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:19,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:19,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7485b1a2967ecb08afbbe8485e3ef38, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:54:19,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:19,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:19,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:19,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:19,375 INFO [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:19,375 DEBUG [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:19,376 DEBUG [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:19,376 INFO [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7485b1a2967ecb08afbbe8485e3ef38 columnFamilyName family1 2023-03-19 14:54:19,381 DEBUG [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/33e52483be504f36aab6efe22c7bd514 2023-03-19 14:54:19,381 INFO [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] regionserver.HStore(310): Store=d7485b1a2967ecb08afbbe8485e3ef38/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:19,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:19,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:19,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:19,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d7485b1a2967ecb08afbbe8485e3ef38; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65448304, jitterRate=-0.024744272232055664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:54:19,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:19,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38., pid=47, masterSystemTime=1679237659370 2023-03-19 14:54:19,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:19,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:19,389 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d7485b1a2967ecb08afbbe8485e3ef38, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:19,389 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237659389"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237659389"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237659389"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237659389"}]},"ts":"1679237659389"} 2023-03-19 14:54:19,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-19 14:54:19,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure d7485b1a2967ecb08afbbe8485e3ef38, server=jenkins-hbase20.apache.org,33191,1679237584457 in 172 msec 2023-03-19 14:54:19,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-19 14:54:19,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, REOPEN/MOVE in 1.0930 sec 2023-03-19 14:54:19,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-19 14:54:19,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0970 sec 2023-03-19 14:54:19,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5180 sec 2023-03-19 14:54:19,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-19 14:54:19,398 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(278): alter status finished 2023-03-19 14:54:19,399 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:19,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-19 14:54:19,401 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-19 14:54:19,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:19,401 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238259401 2023-03-19 14:54:19,402 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:54:19,403 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-19 14:54:19,403 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:19,403 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x54e89b4d to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:54:19,407 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1411371e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:54:19,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:19,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:19,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:19,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:19,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:20,234 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128be4b8935c92b48a6a3a9edb13e253057 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128be4b8935c92b48a6a3a9edb13e253057 2023-03-19 14:54:20,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:20,245 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:54:20,246 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36620, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:54:20,251 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:54:20,253 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:54:20,261 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb9349a1f84c4cb5b87ce4a7dbe804a1 first=Optional[r05] last=Optional[r8] 2023-03-19 14:54:20,261 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb9349a1f84c4cb5b87ce4a7dbe804a1}] 2023-03-19 14:54:20,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb9349a1f84c4cb5b87ce4a7dbe804a1 for inclusion in d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:20,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-19 14:54:20,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:54:20,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:20,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bb9349a1f84c4cb5b87ce4a7dbe804a1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__cqp77865mh0tq4c3fsd3oqgrn9gn7uqlfgmfthe74ig5vpu9jmpqt6t8j2e1ckki/family1/bb9349a1f84c4cb5b87ce4a7dbe804a1 2023-03-19 14:54:20,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__cqp77865mh0tq4c3fsd3oqgrn9gn7uqlfgmfthe74ig5vpu9jmpqt6t8j2e1ckki/family1/bb9349a1f84c4cb5b87ce4a7dbe804a1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/dc81149f748f4b69931f226e502981c1_SeqId_53_ 2023-03-19 14:54:20,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__cqp77865mh0tq4c3fsd3oqgrn9gn7uqlfgmfthe74ig5vpu9jmpqt6t8j2e1ckki/family1/bb9349a1f84c4cb5b87ce4a7dbe804a1 into d7485b1a2967ecb08afbbe8485e3ef38/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/dc81149f748f4b69931f226e502981c1_SeqId_53_ - updating store file list. 2023-03-19 14:54:20,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/dc81149f748f4b69931f226e502981c1_SeqId_53_ into d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:20,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__cqp77865mh0tq4c3fsd3oqgrn9gn7uqlfgmfthe74ig5vpu9jmpqt6t8j2e1ckki/family1/bb9349a1f84c4cb5b87ce4a7dbe804a1 into d7485b1a2967ecb08afbbe8485e3ef38/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/dc81149f748f4b69931f226e502981c1_SeqId_53_) 2023-03-19 14:54:20,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__cqp77865mh0tq4c3fsd3oqgrn9gn7uqlfgmfthe74ig5vpu9jmpqt6t8j2e1ckki/family1/bb9349a1f84c4cb5b87ce4a7dbe804a1 2023-03-19 14:54:20,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:20,278 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:20,280 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c333a97fea8a4c56ab07bde9dfb8ac7e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c333a97fea8a4c56ab07bde9dfb8ac7e 2023-03-19 14:54:20,283 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d3c0c1a71db94c73ad6bcb40555e6458 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d3c0c1a71db94c73ad6bcb40555e6458 2023-03-19 14:54:20,283 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-19 14:54:20,283 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-19 14:54:20,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:20,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:20,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:20,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:20,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:20,284 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-19 14:54:20,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 886 msec 2023-03-19 14:54:20,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-19 14:54:20,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:20,752 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-19 14:54:20,755 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-19 14:54:20,755 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-19 14:54:20,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-19 14:54:20,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, REOPEN/MOVE}] 2023-03-19 14:54:20,763 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, REOPEN/MOVE 2023-03-19 14:54:20,765 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d7485b1a2967ecb08afbbe8485e3ef38, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:20,765 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237660765"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237660765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237660765"}]},"ts":"1679237660765"} 2023-03-19 14:54:20,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure d7485b1a2967ecb08afbbe8485e3ef38, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:20,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:20,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d7485b1a2967ecb08afbbe8485e3ef38, disabling compactions & flushes 2023-03-19 14:54:20,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:20,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:20,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. after waiting 0 ms 2023-03-19 14:54:20,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:20,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-19 14:54:20,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:20,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:20,934 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: d7485b1a2967ecb08afbbe8485e3ef38 to self. 2023-03-19 14:54:20,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:20,936 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d7485b1a2967ecb08afbbe8485e3ef38, regionState=CLOSED 2023-03-19 14:54:20,936 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237660936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237660936"}]},"ts":"1679237660936"} 2023-03-19 14:54:20,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-19 14:54:20,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure d7485b1a2967ecb08afbbe8485e3ef38, server=jenkins-hbase20.apache.org,33191,1679237584457 in 171 msec 2023-03-19 14:54:20,940 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=true 2023-03-19 14:54:21,091 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d7485b1a2967ecb08afbbe8485e3ef38, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:21,091 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237661091"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237661091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237661091"}]},"ts":"1679237661091"} 2023-03-19 14:54:21,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure d7485b1a2967ecb08afbbe8485e3ef38, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:21,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:21,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7485b1a2967ecb08afbbe8485e3ef38, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:54:21,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:21,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:21,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:21,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:21,260 INFO [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:21,262 DEBUG [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:21,263 DEBUG [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1 2023-03-19 14:54:21,263 INFO [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7485b1a2967ecb08afbbe8485e3ef38 columnFamilyName family1 2023-03-19 14:54:21,273 DEBUG [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/33e52483be504f36aab6efe22c7bd514 2023-03-19 14:54:21,277 DEBUG [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/family1/dc81149f748f4b69931f226e502981c1_SeqId_53_ 2023-03-19 14:54:21,277 INFO [StoreOpener-d7485b1a2967ecb08afbbe8485e3ef38-1] regionserver.HStore(310): Store=d7485b1a2967ecb08afbbe8485e3ef38/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:21,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:21,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:21,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:54:21,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d7485b1a2967ecb08afbbe8485e3ef38; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66617918, jitterRate=-0.0073156654834747314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:54:21,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:54:21,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38., pid=53, masterSystemTime=1679237661247 2023-03-19 14:54:21,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:21,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:54:21,285 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d7485b1a2967ecb08afbbe8485e3ef38, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:21,285 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1679237661284"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237661284"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237661284"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237661284"}]},"ts":"1679237661284"} 2023-03-19 14:54:21,287 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-19 14:54:21,287 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure d7485b1a2967ecb08afbbe8485e3ef38, server=jenkins-hbase20.apache.org,33191,1679237584457 in 192 msec 2023-03-19 14:54:21,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-19 14:54:21,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d7485b1a2967ecb08afbbe8485e3ef38, REOPEN/MOVE in 525 msec 2023-03-19 14:54:21,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-19 14:54:21,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 530 msec 2023-03-19 14:54:21,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 952 msec 2023-03-19 14:54:21,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-19 14:54:21,293 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(278): alter status finished 2023-03-19 14:54:21,294 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-19 14:54:21,295 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-19 14:54:21,296 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-19 14:54:21,296 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:21,296 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238261296 2023-03-19 14:54:21,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:54:21,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-19 14:54:21,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:21,298 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x743c4a42 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:54:21,301 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69882a1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:54:21,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:21,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:21,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:21,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:21,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:21,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:21,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:21,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-19 14:54:21,302 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-19 14:54:21,302 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:21,303 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-19 14:54:21,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-03-19 14:54:21,353 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=246 (was 253), OpenFileDescriptor=625 (was 614) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=256 (was 259), ProcessCount=168 (was 168), AvailableMemoryMB=4270 (was 4425) 2023-03-19 14:54:21,363 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=246, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=168, AvailableMemoryMB=4270 2023-03-19 14:54:21,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-19 14:54:21,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:21,367 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:54:21,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-19 14:54:21,368 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:54:21,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-19 14:54:21,369 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:21,369 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56 empty. 2023-03-19 14:54:21,370 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:21,370 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-19 14:54:21,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-19 14:54:21,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-19 14:54:21,777 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-19 14:54:21,779 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 525b5eabd1937cfff55f6add30c5ff56, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:54:21,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-19 14:54:22,188 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:22,188 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 525b5eabd1937cfff55f6add30c5ff56, disabling compactions & flushes 2023-03-19 14:54:22,188 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:22,189 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:22,189 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. after waiting 0 ms 2023-03-19 14:54:22,189 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:22,189 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:22,189 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:22,194 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:54:22,196 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237662195"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237662195"}]},"ts":"1679237662195"} 2023-03-19 14:54:22,197 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-19 14:54:22,198 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:54:22,199 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237662199"}]},"ts":"1679237662199"} 2023-03-19 14:54:22,200 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-19 14:54:22,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, ASSIGN}] 2023-03-19 14:54:22,206 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, ASSIGN 2023-03-19 14:54:22,208 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:54:22,359 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=525b5eabd1937cfff55f6add30c5ff56, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:22,359 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237662359"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237662359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237662359"}]},"ts":"1679237662359"} 2023-03-19 14:54:22,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 525b5eabd1937cfff55f6add30c5ff56, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:22,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-19 14:54:22,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:22,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 525b5eabd1937cfff55f6add30c5ff56, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:54:22,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:22,526 INFO [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:22,528 DEBUG [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:22,528 DEBUG [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:22,529 INFO [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 525b5eabd1937cfff55f6add30c5ff56 columnFamilyName family1 2023-03-19 14:54:22,530 INFO [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] regionserver.HStore(310): Store=525b5eabd1937cfff55f6add30c5ff56/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:22,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:22,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:22,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:22,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:54:22,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 525b5eabd1937cfff55f6add30c5ff56; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61503634, jitterRate=-0.0835244357585907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:54:22,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:22,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56., pid=57, masterSystemTime=1679237662515 2023-03-19 14:54:22,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:22,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:22,542 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=525b5eabd1937cfff55f6add30c5ff56, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:22,542 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237662542"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237662542"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237662542"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237662542"}]},"ts":"1679237662542"} 2023-03-19 14:54:22,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-19 14:54:22,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 525b5eabd1937cfff55f6add30c5ff56, server=jenkins-hbase20.apache.org,33191,1679237584457 in 182 msec 2023-03-19 14:54:22,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-19 14:54:22,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, ASSIGN in 342 msec 2023-03-19 14:54:22,548 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:54:22,549 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237662549"}]},"ts":"1679237662549"} 2023-03-19 14:54:22,550 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-19 14:54:22,552 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:54:22,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1870 sec 2023-03-19 14:54:23,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-19 14:54:23,479 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-19 14:54:23,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:23,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:23,510 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:23,510 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:23,511 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-19 14:54:23,511 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-19 14:54:23,511 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:23,511 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:23,512 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:23,512 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:23,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:23,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:23,512 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:23,512 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:23,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:23,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:23,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:23,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:23,513 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:23,513 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:23,513 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-19 14:54:23,513 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:23,513 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-19 14:54:23,513 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:23,513 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:23,513 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:23,513 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. started... 2023-03-19 14:54:23,514 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 525b5eabd1937cfff55f6add30c5ff56 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-19 14:54:23,941 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130866e385b4103445f96ef0e9f4d080b35 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130866e385b4103445f96ef0e9f4d080b35 2023-03-19 14:54:24,346 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/0ac82e4d4a5a4a8fadd1f94ea3a10ab9 2023-03-19 14:54:24,357 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/0ac82e4d4a5a4a8fadd1f94ea3a10ab9 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/0ac82e4d4a5a4a8fadd1f94ea3a10ab9 2023-03-19 14:54:24,362 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/0ac82e4d4a5a4a8fadd1f94ea3a10ab9, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-19 14:54:24,363 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 525b5eabd1937cfff55f6add30c5ff56 in 849ms, sequenceid=5, compaction requested=false 2023-03-19 14:54:24,363 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:24,364 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:24,364 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:24,364 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:24,364 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:24,364 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,364 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-19 14:54:24,364 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-19 14:54:24,365 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:24,365 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:24,366 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,366 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:24,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-19 14:54:24,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4675211c[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:24,367 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-19 14:54:24,367 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,367 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,367 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-19 14:54:24,367 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-19 14:54:24,368 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:24,368 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,368 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:24,368 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-19 14:54:24,368 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,368 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:24,368 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-19 14:54:24,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:24,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:24,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:24,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:24,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-19 14:54:24,370 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-19 14:54:24,370 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:24,370 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:24,370 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,370 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:24,371 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,371 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,371 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:24,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:24,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:24,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,371 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:24,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:24,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,372 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,374 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,374 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,374 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,374 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:24,374 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:24,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:24,374 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,374 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,374 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,374 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:24,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:24,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:24,374 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:24,375 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:24,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-19 14:54:24,375 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:24,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:24,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:24,475 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:24,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:24,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:24,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:24,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,481 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:24,481 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:24,481 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-19 14:54:24,481 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-19 14:54:24,481 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,481 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,482 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:24,482 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:24,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:24,482 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:24,482 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:24,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:24,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,483 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,483 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-19 14:54:24,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:24,483 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-19 14:54:24,483 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:24,484 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-19 14:54:24,484 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:24,484 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:24,484 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:24,484 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. started... 2023-03-19 14:54:24,484 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 525b5eabd1937cfff55f6add30c5ff56 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-19 14:54:24,594 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:54:24,630 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x743c4a42 to 127.0.0.1:56323 2023-03-19 14:54:24,630 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:54:24,630 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:54:24,630 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54e89b4d to 127.0.0.1:56323 2023-03-19 14:54:24,630 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:54:24,630 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:54:24,630 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1eb1812a to 127.0.0.1:56323 2023-03-19 14:54:24,630 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:54:24,630 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:54:24,630 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x420512a0 to 127.0.0.1:56323 2023-03-19 14:54:24,630 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:54:24,630 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:54:24,631 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08c486ad to 127.0.0.1:56323 2023-03-19 14:54:24,631 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:54:24,905 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285c4c50d90210426f95bd8c7f77273cad to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285c4c50d90210426f95bd8c7f77273cad 2023-03-19 14:54:25,313 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/8ee1bb0e7c3a464294f6d84fc6e8edf5 2023-03-19 14:54:25,325 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/8ee1bb0e7c3a464294f6d84fc6e8edf5 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8ee1bb0e7c3a464294f6d84fc6e8edf5 2023-03-19 14:54:25,333 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8ee1bb0e7c3a464294f6d84fc6e8edf5, entries=1, sequenceid=9, filesize=5.0 K 2023-03-19 14:54:25,334 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 525b5eabd1937cfff55f6add30c5ff56 in 850ms, sequenceid=9, compaction requested=false 2023-03-19 14:54:25,334 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:25,334 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:25,334 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:25,334 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:25,334 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,334 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-19 14:54:25,334 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-19 14:54:25,336 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,336 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:25,336 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,336 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:25,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-19 14:54:25,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10a95e56[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:25,338 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-19 14:54:25,338 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,339 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,339 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-19 14:54:25,339 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-19 14:54:25,339 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:25,339 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,340 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:25,340 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-19 14:54:25,340 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:25,340 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,340 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-19 14:54:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:25,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-19 14:54:25,343 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-19 14:54:25,344 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:25,344 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:25,344 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,344 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:25,345 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,345 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:25,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,345 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:25,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:25,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:25,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:25,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:25,346 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,348 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:25,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,351 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,351 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:25,351 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:25,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:25,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:25,351 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:25,351 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,351 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:25,352 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,352 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,352 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:25,352 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,352 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:25,352 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:25,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:25,453 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:25,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:25,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:25,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:25,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,467 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:25,467 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:25,467 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-19 14:54:25,467 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-19 14:54:25,468 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,468 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,470 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,470 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:25,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:25,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:25,470 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:25,470 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:25,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:25,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,471 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,471 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-19 14:54:25,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:25,471 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-19 14:54:25,471 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:25,471 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-19 14:54:25,471 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:25,471 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:25,472 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:25,472 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. started... 2023-03-19 14:54:25,472 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 525b5eabd1937cfff55f6add30c5ff56 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:25,892 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201dcb9619b39324d1bac8eaab6bb889142 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201dcb9619b39324d1bac8eaab6bb889142 2023-03-19 14:54:26,300 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/a218ad54cb6741c480e34d3a2d11c32c 2023-03-19 14:54:26,313 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/a218ad54cb6741c480e34d3a2d11c32c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/a218ad54cb6741c480e34d3a2d11c32c 2023-03-19 14:54:26,320 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/a218ad54cb6741c480e34d3a2d11c32c, entries=1, sequenceid=13, filesize=5.0 K 2023-03-19 14:54:26,321 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 525b5eabd1937cfff55f6add30c5ff56 in 849ms, sequenceid=13, compaction requested=true 2023-03-19 14:54:26,321 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:26,321 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:26,321 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:26,321 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:26,321 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,321 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-19 14:54:26,321 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-19 14:54:26,323 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,323 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:26,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:26,323 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,323 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:26,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:26,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:26,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:26,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-19 14:54:26,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c8cfd7d[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:26,326 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-19 14:54:26,326 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,327 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,327 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-19 14:54:26,327 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-19 14:54:26,327 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:26,327 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,328 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:26,329 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-19 14:54:26,329 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:26,329 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-19 14:54:26,329 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:26,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:26,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:26,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:26,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-19 14:54:26,333 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-19 14:54:26,333 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:26,333 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:26,333 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,333 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:26,343 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,343 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,343 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:26,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:26,344 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:26,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,347 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:26,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,351 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,352 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,352 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:26,352 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:26,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-19 14:54:26,352 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:26,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:26,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:26,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:26,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:26,352 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,353 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,353 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,353 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:26,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:26,353 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:26,353 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,353 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:26,454 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:26,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:26,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:26,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:26,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,466 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:26,466 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:26,466 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-19 14:54:26,466 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-19 14:54:26,467 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,467 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,469 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:26,469 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:26,470 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:26,470 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:26,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,472 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,472 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-19 14:54:26,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:26,473 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-19 14:54:26,473 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:26,473 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-19 14:54:26,473 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:26,473 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:26,473 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:26,473 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. started... 2023-03-19 14:54:26,474 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 525b5eabd1937cfff55f6add30c5ff56 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:26,897 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051fa7fbda504843b8806414743e76f855 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512051fa7fbda504843b8806414743e76f855 2023-03-19 14:54:27,307 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/3f04cb562aa741c499d3578c7ca45643 2023-03-19 14:54:27,318 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/3f04cb562aa741c499d3578c7ca45643 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f04cb562aa741c499d3578c7ca45643 2023-03-19 14:54:27,322 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f04cb562aa741c499d3578c7ca45643, entries=1, sequenceid=17, filesize=5.0 K 2023-03-19 14:54:27,323 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 525b5eabd1937cfff55f6add30c5ff56 in 850ms, sequenceid=17, compaction requested=true 2023-03-19 14:54:27,323 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:27,323 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:27,323 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:27,323 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:27,323 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,323 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-19 14:54:27,323 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-19 14:54:27,324 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,324 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:27,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:27,324 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,324 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:27,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:27,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-19 14:54:27,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11d500f7[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:27,326 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-19 14:54:27,326 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,326 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,326 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-19 14:54:27,326 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-19 14:54:27,326 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:27,327 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,327 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:27,327 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-19 14:54:27,327 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:27,327 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,327 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-19 14:54:27,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:27,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:27,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:27,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:27,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:27,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:27,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-19 14:54:27,329 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-19 14:54:27,329 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:27,329 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:27,329 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,329 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:27,330 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,330 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:27,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:27,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,330 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:27,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:27,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:27,331 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:27,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:27,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,331 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:27,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,332 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:27,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:27,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:27,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:27,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:27,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-19 14:54:27,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,333 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:27,333 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:27,333 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:27,333 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:27,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:27,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:27,433 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:27,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:27,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:27,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:27,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,443 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:27,443 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:27,443 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-19 14:54:27,443 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-19 14:54:27,444 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,444 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,446 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,446 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:27,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:27,446 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:27,446 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:27,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:27,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,448 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,449 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-19 14:54:27,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:27,449 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-19 14:54:27,449 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:27,449 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-19 14:54:27,449 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:27,449 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:27,449 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:27,449 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. started... 2023-03-19 14:54:27,450 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 525b5eabd1937cfff55f6add30c5ff56 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:27,875 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280eb5916391cc407a89a0a2f10c7c0e07 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512280eb5916391cc407a89a0a2f10c7c0e07 2023-03-19 14:54:28,281 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/3f7e6d9aa1a54db5b4f9a44c6ec42cf1 2023-03-19 14:54:28,290 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/3f7e6d9aa1a54db5b4f9a44c6ec42cf1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f7e6d9aa1a54db5b4f9a44c6ec42cf1 2023-03-19 14:54:28,297 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f7e6d9aa1a54db5b4f9a44c6ec42cf1, entries=1, sequenceid=21, filesize=5.0 K 2023-03-19 14:54:28,298 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 525b5eabd1937cfff55f6add30c5ff56 in 848ms, sequenceid=21, compaction requested=true 2023-03-19 14:54:28,298 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:28,298 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:28,298 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:28,298 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:28,298 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,298 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-19 14:54:28,298 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-19 14:54:28,300 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,300 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:28,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:28,300 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,300 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:28,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:28,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:28,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:28,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-19 14:54:28,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ec7be10[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:28,302 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-19 14:54:28,303 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,303 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,304 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-19 14:54:28,304 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-19 14:54:28,304 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,304 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:28,304 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:28,305 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-19 14:54:28,305 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,305 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:28,305 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-19 14:54:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:28,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:28,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:28,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:28,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-19 14:54:28,308 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-19 14:54:28,308 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:28,308 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:28,308 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,308 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:28,309 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,309 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:28,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,309 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:28,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:28,310 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,311 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,312 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,312 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:28,312 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:28,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:28,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:28,312 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:28,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:28,312 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:28,312 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-19 14:54:28,312 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,312 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:28,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:28,312 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:28,312 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:28,313 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,313 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,413 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:28,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:28,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:28,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:28,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,419 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:28,419 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:28,419 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-19 14:54:28,419 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-19 14:54:28,420 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,420 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,421 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,421 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:28,421 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:28,421 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:28,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,422 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,422 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-19 14:54:28,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:28,422 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-19 14:54:28,422 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:28,422 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-19 14:54:28,422 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:28,422 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:28,422 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:28,423 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. started... 2023-03-19 14:54:28,423 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 525b5eabd1937cfff55f6add30c5ff56 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:28,843 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319eb33863a3c745f18b194273b34198d6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512319eb33863a3c745f18b194273b34198d6 2023-03-19 14:54:29,251 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/3ed6c31f73564956b715b7450fc86c6c 2023-03-19 14:54:29,263 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/3ed6c31f73564956b715b7450fc86c6c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3ed6c31f73564956b715b7450fc86c6c 2023-03-19 14:54:29,266 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3ed6c31f73564956b715b7450fc86c6c, entries=1, sequenceid=25, filesize=5.0 K 2023-03-19 14:54:29,267 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 525b5eabd1937cfff55f6add30c5ff56 in 844ms, sequenceid=25, compaction requested=true 2023-03-19 14:54:29,267 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:29,267 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:29,267 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:29,267 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:29,267 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,267 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-19 14:54:29,267 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-19 14:54:29,269 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,269 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:29,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:29,269 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,269 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:29,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:29,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:29,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:29,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-19 14:54:29,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24460470[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:29,270 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-19 14:54:29,270 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,271 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,271 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-19 14:54:29,271 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-19 14:54:29,271 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:29,271 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,271 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:29,273 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,273 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-19 14:54:29,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:29,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:29,273 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:29,273 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-19 14:54:29,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:29,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:29,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:29,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:29,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-19 14:54:29,275 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-19 14:54:29,275 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:29,275 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:29,275 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,275 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:29,276 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,276 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:29,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:29,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,276 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:29,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:29,277 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,277 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:29,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:29,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:29,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,279 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:29,279 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:29,379 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:29,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:29,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:29,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:29,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,390 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:29,390 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:29,390 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-19 14:54:29,390 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-19 14:54:29,391 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,391 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,393 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:29,393 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:29,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:29,394 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:29,394 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:29,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:29,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,395 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,396 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-19 14:54:29,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:29,396 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-19 14:54:29,396 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:29,396 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-19 14:54:29,396 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:29,396 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:29,397 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:29,397 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. started... 2023-03-19 14:54:29,397 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 525b5eabd1937cfff55f6add30c5ff56 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:29,820 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010116f513408cbd48d7af780b24c802df05 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010116f513408cbd48d7af780b24c802df05 2023-03-19 14:54:30,230 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/93578c1a2d0245e091d7e64e3351b7ac 2023-03-19 14:54:30,238 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/93578c1a2d0245e091d7e64e3351b7ac as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/93578c1a2d0245e091d7e64e3351b7ac 2023-03-19 14:54:30,242 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/93578c1a2d0245e091d7e64e3351b7ac, entries=1, sequenceid=29, filesize=5.0 K 2023-03-19 14:54:30,243 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 525b5eabd1937cfff55f6add30c5ff56 in 846ms, sequenceid=29, compaction requested=true 2023-03-19 14:54:30,243 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:30,243 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:30,244 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:30,244 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:30,244 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,244 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-19 14:54:30,244 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-19 14:54:30,245 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,245 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:30,246 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,246 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:30,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:30,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:30,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:30,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-19 14:54:30,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f5a6290[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:30,248 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-19 14:54:30,248 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,248 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,249 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-19 14:54:30,249 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-19 14:54:30,249 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:30,249 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,249 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:30,250 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-19 14:54:30,250 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:30,250 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-19 14:54:30,250 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:30,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:30,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-19 14:54:30,254 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-19 14:54:30,254 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:30,254 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:30,254 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,254 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:30,256 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,256 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:30,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:30,256 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:30,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:30,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:30,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:30,257 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,259 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,261 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,261 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,261 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,261 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,262 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:30,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-19 14:54:30,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:30,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:30,262 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,262 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:30,262 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:30,262 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:30,262 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:30,262 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:30,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:30,262 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:30,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:30,363 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:30,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:30,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:30,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:30,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,369 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:30,370 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:30,370 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-19 14:54:30,370 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-19 14:54:30,370 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,370 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,371 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:30,371 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:30,372 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:30,372 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,373 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,373 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-19 14:54:30,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:30,373 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-19 14:54:30,373 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:30,373 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-19 14:54:30,382 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:30,382 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:30,382 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:30,382 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. started... 2023-03-19 14:54:30,382 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 525b5eabd1937cfff55f6add30c5ff56 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:30,800 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039b31cf3b87564415ab7272c09c0f128e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039b31cf3b87564415ab7272c09c0f128e 2023-03-19 14:54:31,207 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/ac57fa1914ad47ccb66241a0b47f8cff 2023-03-19 14:54:31,216 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/ac57fa1914ad47ccb66241a0b47f8cff as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/ac57fa1914ad47ccb66241a0b47f8cff 2023-03-19 14:54:31,221 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/ac57fa1914ad47ccb66241a0b47f8cff, entries=1, sequenceid=33, filesize=5.0 K 2023-03-19 14:54:31,222 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 525b5eabd1937cfff55f6add30c5ff56 in 839ms, sequenceid=33, compaction requested=true 2023-03-19 14:54:31,222 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:31,222 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:31,222 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:31,222 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:31,222 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,222 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-19 14:54:31,222 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-19 14:54:31,223 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,223 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:31,223 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:31,223 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:31,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-19 14:54:31,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66311334[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:31,224 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-19 14:54:31,224 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,225 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,225 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-19 14:54:31,225 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-19 14:54:31,225 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:31,225 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,225 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:31,226 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-19 14:54:31,226 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:31,226 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-19 14:54:31,226 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:31,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-19 14:54:31,228 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-19 14:54:31,228 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:31,228 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:31,228 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,228 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:31,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:31,229 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:31,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:31,229 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,230 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,232 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:31,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:31,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:31,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:31,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:31,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:31,232 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:31,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:31,333 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:31,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:31,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:31,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:31,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,341 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:31,341 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:31,341 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-19 14:54:31,341 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-19 14:54:31,342 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,342 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,343 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,343 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:31,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:31,343 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:31,343 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:31,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:31,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,344 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,344 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-19 14:54:31,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:31,344 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-19 14:54:31,344 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:31,344 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-19 14:54:31,344 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:31,344 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:31,344 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:31,345 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. started... 2023-03-19 14:54:31,345 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 525b5eabd1937cfff55f6add30c5ff56 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:31,764 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907436a7932a53c46b8975e2ba4406d9c21 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907436a7932a53c46b8975e2ba4406d9c21 2023-03-19 14:54:32,172 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/d28f04a55f1c4b68ae05a224c42706c0 2023-03-19 14:54:32,185 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/d28f04a55f1c4b68ae05a224c42706c0 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/d28f04a55f1c4b68ae05a224c42706c0 2023-03-19 14:54:32,190 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/d28f04a55f1c4b68ae05a224c42706c0, entries=1, sequenceid=37, filesize=5.0 K 2023-03-19 14:54:32,191 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 525b5eabd1937cfff55f6add30c5ff56 in 846ms, sequenceid=37, compaction requested=true 2023-03-19 14:54:32,191 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:32,191 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:32,191 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:32,191 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:32,191 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,191 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-19 14:54:32,192 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-19 14:54:32,193 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,193 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:32,193 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,193 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:32,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:32,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:32,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:32,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-19 14:54:32,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@254516dc[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:32,195 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-19 14:54:32,195 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,196 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-19 14:54:32,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-19 14:54:32,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:32,196 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,196 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:32,197 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,197 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-19 14:54:32,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:32,197 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:32,198 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-19 14:54:32,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:32,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:32,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-19 14:54:32,202 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-19 14:54:32,202 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:32,202 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:32,202 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,202 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:32,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:32,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,210 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:32,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,211 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:32,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,218 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,218 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:32,218 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:32,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:32,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-19 14:54:32,218 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:32,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:32,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:32,218 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:32,218 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,218 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,219 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:32,219 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:32,219 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,219 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,219 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:32,319 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:32,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:32,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:32,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:32,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,333 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:32,333 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:32,333 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-19 14:54:32,333 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-19 14:54:32,333 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,333 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,334 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,334 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:32,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:32,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:32,335 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:32,335 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:32,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:32,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,336 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,337 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-19 14:54:32,337 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:32,337 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-19 14:54:32,337 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:32,337 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-19 14:54:32,337 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:54:32,337 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:32,337 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:32,337 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. started... 2023-03-19 14:54:32,337 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 525b5eabd1937cfff55f6add30c5ff56 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:54:32,754 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204bd9805f4ad440378bcf156e106ff5b4 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511204bd9805f4ad440378bcf156e106ff5b4 2023-03-19 14:54:33,162 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/7a84b961a7b94af6bd52e4627e7148b9 2023-03-19 14:54:33,173 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/7a84b961a7b94af6bd52e4627e7148b9 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/7a84b961a7b94af6bd52e4627e7148b9 2023-03-19 14:54:33,181 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/7a84b961a7b94af6bd52e4627e7148b9, entries=1, sequenceid=41, filesize=5.0 K 2023-03-19 14:54:33,182 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 525b5eabd1937cfff55f6add30c5ff56 in 845ms, sequenceid=41, compaction requested=true 2023-03-19 14:54:33,182 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:33,182 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:33,182 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:54:33,182 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:54:33,182 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,182 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-19 14:54:33,182 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-19 14:54:33,184 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,184 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:33,184 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,185 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:33,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-19 14:54:33,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31b4f380[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:33,187 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-19 14:54:33,187 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,188 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,188 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-19 14:54:33,188 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-19 14:54:33,188 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:33,188 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,188 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:33,189 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-19 14:54:33,189 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,189 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:33,189 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-19 14:54:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:33,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-19 14:54:33,192 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-19 14:54:33,193 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:33,193 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:33,193 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,193 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:33,201 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,201 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:33,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:33,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,202 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:33,203 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:33,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:33,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:33,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,205 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:33,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:33,210 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:33,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:33,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-19 14:54:33,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:33,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:33,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:33,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:33,210 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:33,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:33,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:33,211 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:33,212 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:33,312 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:33,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:33,317 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:33,320 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-19 14:54:33,322 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-19 14:54:33,323 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238273323 2023-03-19 14:54:33,323 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:33,325 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:54:33,326 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-19 14:54:33,326 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:33,327 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x06ffdd9e to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:54:33,332 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f3421d8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:54:33,332 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:34,181 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035a696e6ed8b84c738db75a41db6801b7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601035a696e6ed8b84c738db75a41db6801b7 2023-03-19 14:54:34,182 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:34,198 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:54:34,199 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38112, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:54:34,207 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:54:34,208 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47132, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:54:34,216 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0265feb5a4244e86803a555b139bf96a first=Optional[r3] last=Optional[r6] 2023-03-19 14:54:34,216 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0265feb5a4244e86803a555b139bf96a}] 2023-03-19 14:54:34,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0265feb5a4244e86803a555b139bf96a for inclusion in 525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:34,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-19 14:54:34,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:54:34,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:34,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0265feb5a4244e86803a555b139bf96a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ungvb8j8dr7oblbihuoa3q5ct9n70b4bdkp2fpmd1g58dk4f7vrv2rou42pp26s8/family1/0265feb5a4244e86803a555b139bf96a 2023-03-19 14:54:34,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ungvb8j8dr7oblbihuoa3q5ct9n70b4bdkp2fpmd1g58dk4f7vrv2rou42pp26s8/family1/0265feb5a4244e86803a555b139bf96a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8b0b60867f5547818d0907dea8f7d07c_SeqId_44_ 2023-03-19 14:54:34,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ungvb8j8dr7oblbihuoa3q5ct9n70b4bdkp2fpmd1g58dk4f7vrv2rou42pp26s8/family1/0265feb5a4244e86803a555b139bf96a into 525b5eabd1937cfff55f6add30c5ff56/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8b0b60867f5547818d0907dea8f7d07c_SeqId_44_ - updating store file list. 2023-03-19 14:54:34,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8b0b60867f5547818d0907dea8f7d07c_SeqId_44_ into 525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:34,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ungvb8j8dr7oblbihuoa3q5ct9n70b4bdkp2fpmd1g58dk4f7vrv2rou42pp26s8/family1/0265feb5a4244e86803a555b139bf96a into 525b5eabd1937cfff55f6add30c5ff56/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8b0b60867f5547818d0907dea8f7d07c_SeqId_44_) 2023-03-19 14:54:34,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ungvb8j8dr7oblbihuoa3q5ct9n70b4bdkp2fpmd1g58dk4f7vrv2rou42pp26s8/family1/0265feb5a4244e86803a555b139bf96a 2023-03-19 14:54:34,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-19 14:54:34,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-19 14:54:34,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 525b5eabd1937cfff55f6add30c5ff56/family1 is initiating minor compaction 2023-03-19 14:54:34,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@533756d9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:34,237 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 525b5eabd1937cfff55f6add30c5ff56/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:34,237 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8ee1bb0e7c3a464294f6d84fc6e8edf5, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/a218ad54cb6741c480e34d3a2d11c32c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f04cb562aa741c499d3578c7ca45643, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f7e6d9aa1a54db5b4f9a44c6ec42cf1, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3ed6c31f73564956b715b7450fc86c6c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/93578c1a2d0245e091d7e64e3351b7ac, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/ac57fa1914ad47ccb66241a0b47f8cff, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/d28f04a55f1c4b68ae05a224c42706c0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/7a84b961a7b94af6bd52e4627e7148b9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8b0b60867f5547818d0907dea8f7d07c_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp, totalSize=50.3 K 2023-03-19 14:54:34,238 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 8ee1bb0e7c3a464294f6d84fc6e8edf5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-19 14:54:34,238 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting a218ad54cb6741c480e34d3a2d11c32c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-19 14:54:34,238 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 3f04cb562aa741c499d3578c7ca45643, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-19 14:54:34,238 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 3f7e6d9aa1a54db5b4f9a44c6ec42cf1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-19 14:54:34,238 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 3ed6c31f73564956b715b7450fc86c6c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-19 14:54:34,238 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 93578c1a2d0245e091d7e64e3351b7ac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-19 14:54:34,238 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting ac57fa1914ad47ccb66241a0b47f8cff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-19 14:54:34,239 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting d28f04a55f1c4b68ae05a224c42706c0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-19 14:54:34,239 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 7a84b961a7b94af6bd52e4627e7148b9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-19 14:54:34,239 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 8b0b60867f5547818d0907dea8f7d07c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-19 14:54:34,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:34,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:34,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512280eb5916391cc407a89a0a2f10c7c0e07 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512280eb5916391cc407a89a0a2f10c7c0e07 2023-03-19 14:54:34,243 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512319eb33863a3c745f18b194273b34198d6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512319eb33863a3c745f18b194273b34198d6 2023-03-19 14:54:34,244 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010116f513408cbd48d7af780b24c802df05 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010116f513408cbd48d7af780b24c802df05 2023-03-19 14:54:34,244 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039b31cf3b87564415ab7272c09c0f128e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039b31cf3b87564415ab7272c09c0f128e 2023-03-19 14:54:34,244 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-19 14:54:34,244 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-19 14:54:34,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:34,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:34,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:34,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:34,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:34,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:34,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:34,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:34,272 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 525b5eabd1937cfff55f6add30c5ff56#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:54:34,710 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/6013eff7670b436a8f46f46f64c16352 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/6013eff7670b436a8f46f46f64c16352 2023-03-19 14:54:34,716 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 525b5eabd1937cfff55f6add30c5ff56/family1 of 525b5eabd1937cfff55f6add30c5ff56 into 6013eff7670b436a8f46f46f64c16352(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:54:34,717 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:34,717 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1679237674237; duration=0sec 2023-03-19 14:54:34,717 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:34,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8ee1bb0e7c3a464294f6d84fc6e8edf5, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/a218ad54cb6741c480e34d3a2d11c32c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f04cb562aa741c499d3578c7ca45643, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f7e6d9aa1a54db5b4f9a44c6ec42cf1, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3ed6c31f73564956b715b7450fc86c6c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/93578c1a2d0245e091d7e64e3351b7ac, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/ac57fa1914ad47ccb66241a0b47f8cff, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/d28f04a55f1c4b68ae05a224c42706c0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/7a84b961a7b94af6bd52e4627e7148b9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8b0b60867f5547818d0907dea8f7d07c_SeqId_44_] to archive 2023-03-19 14:54:34,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:34,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8ee1bb0e7c3a464294f6d84fc6e8edf5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8ee1bb0e7c3a464294f6d84fc6e8edf5 2023-03-19 14:54:34,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/a218ad54cb6741c480e34d3a2d11c32c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/a218ad54cb6741c480e34d3a2d11c32c 2023-03-19 14:54:34,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f04cb562aa741c499d3578c7ca45643 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f04cb562aa741c499d3578c7ca45643 2023-03-19 14:54:34,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f7e6d9aa1a54db5b4f9a44c6ec42cf1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3f7e6d9aa1a54db5b4f9a44c6ec42cf1 2023-03-19 14:54:34,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3ed6c31f73564956b715b7450fc86c6c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/3ed6c31f73564956b715b7450fc86c6c 2023-03-19 14:54:34,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/93578c1a2d0245e091d7e64e3351b7ac to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/93578c1a2d0245e091d7e64e3351b7ac 2023-03-19 14:54:34,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/ac57fa1914ad47ccb66241a0b47f8cff to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/ac57fa1914ad47ccb66241a0b47f8cff 2023-03-19 14:54:34,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/d28f04a55f1c4b68ae05a224c42706c0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/d28f04a55f1c4b68ae05a224c42706c0 2023-03-19 14:54:34,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/7a84b961a7b94af6bd52e4627e7148b9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/7a84b961a7b94af6bd52e4627e7148b9 2023-03-19 14:54:34,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8b0b60867f5547818d0907dea8f7d07c_SeqId_44_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/8b0b60867f5547818d0907dea8f7d07c_SeqId_44_ 2023-03-19 14:54:35,113 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f2e2ce4685374dc5a16c7aa6c587a235 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205f2e2ce4685374dc5a16c7aa6c587a235 2023-03-19 14:54:35,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:35,139 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e3dc96fb3f894ae2a14fd709248e8c06 first=Optional[r00] last=Optional[r2] 2023-03-19 14:54:35,140 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e3dc96fb3f894ae2a14fd709248e8c06}] 2023-03-19 14:54:35,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e3dc96fb3f894ae2a14fd709248e8c06 for inclusion in 525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:35,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-19 14:54:35,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:54:35,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:35,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e3dc96fb3f894ae2a14fd709248e8c06 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cm5a8uvvcd31hvk6r46cms73b2akdukmvq78enh6n90ipaneus0aobfhe0r8tsem/family1/e3dc96fb3f894ae2a14fd709248e8c06 2023-03-19 14:54:35,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cm5a8uvvcd31hvk6r46cms73b2akdukmvq78enh6n90ipaneus0aobfhe0r8tsem/family1/e3dc96fb3f894ae2a14fd709248e8c06 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/1502541282c94396abbedf0b2ad2d286_SeqId_47_ 2023-03-19 14:54:35,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cm5a8uvvcd31hvk6r46cms73b2akdukmvq78enh6n90ipaneus0aobfhe0r8tsem/family1/e3dc96fb3f894ae2a14fd709248e8c06 into 525b5eabd1937cfff55f6add30c5ff56/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/1502541282c94396abbedf0b2ad2d286_SeqId_47_ - updating store file list. 2023-03-19 14:54:35,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/1502541282c94396abbedf0b2ad2d286_SeqId_47_ into 525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:35,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cm5a8uvvcd31hvk6r46cms73b2akdukmvq78enh6n90ipaneus0aobfhe0r8tsem/family1/e3dc96fb3f894ae2a14fd709248e8c06 into 525b5eabd1937cfff55f6add30c5ff56/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/1502541282c94396abbedf0b2ad2d286_SeqId_47_) 2023-03-19 14:54:35,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cm5a8uvvcd31hvk6r46cms73b2akdukmvq78enh6n90ipaneus0aobfhe0r8tsem/family1/e3dc96fb3f894ae2a14fd709248e8c06 2023-03-19 14:54:35,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-19 14:54:35,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-19 14:54:35,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 525b5eabd1937cfff55f6add30c5ff56/family1 is initiating minor compaction (all files) 2023-03-19 14:54:35,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@214b4677; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:35,155 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 525b5eabd1937cfff55f6add30c5ff56/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:35,155 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/0ac82e4d4a5a4a8fadd1f94ea3a10ab9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/6013eff7670b436a8f46f46f64c16352, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/1502541282c94396abbedf0b2ad2d286_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp, totalSize=388.1 K 2023-03-19 14:54:35,155 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 0ac82e4d4a5a4a8fadd1f94ea3a10ab9, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878808483 2023-03-19 14:54:35,155 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 6013eff7670b436a8f46f46f64c16352, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621208483 2023-03-19 14:54:35,156 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 1502541282c94396abbedf0b2ad2d286_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878808483 2023-03-19 14:54:35,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:35,157 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:35,158 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130866e385b4103445f96ef0e9f4d080b35 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130866e385b4103445f96ef0e9f4d080b35 2023-03-19 14:54:35,159 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201dcb9619b39324d1bac8eaab6bb889142 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201dcb9619b39324d1bac8eaab6bb889142 2023-03-19 14:54:35,160 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512051fa7fbda504843b8806414743e76f855 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512051fa7fbda504843b8806414743e76f855 2023-03-19 14:54:35,160 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-19 14:54:35,160 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-19 14:54:35,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:35,160 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:35,160 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:35,161 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-19 14:54:35,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8430 sec 2023-03-19 14:54:35,168 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 525b5eabd1937cfff55f6add30c5ff56#family1#compaction#74 average throughput is 35.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:54:35,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-19 14:54:35,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:35,638 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-19 14:54:35,640 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-19 14:54:35,640 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-19 14:54:35,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-19 14:54:35,646 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, REOPEN/MOVE}] 2023-03-19 14:54:35,647 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, REOPEN/MOVE 2023-03-19 14:54:35,648 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=525b5eabd1937cfff55f6add30c5ff56, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:35,648 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237675648"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237675648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237675648"}]},"ts":"1679237675648"} 2023-03-19 14:54:35,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 525b5eabd1937cfff55f6add30c5ff56, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:35,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:35,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 525b5eabd1937cfff55f6add30c5ff56, disabling compactions & flushes 2023-03-19 14:54:35,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:36,409 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/.tmp/family1/e7a37b8a1bce47d086651bd005220900 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/e7a37b8a1bce47d086651bd005220900 2023-03-19 14:54:36,418 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 525b5eabd1937cfff55f6add30c5ff56/family1 of 525b5eabd1937cfff55f6add30c5ff56 into e7a37b8a1bce47d086651bd005220900(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:54:36,418 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:36,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:36,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:36,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. after waiting 0 ms 2023-03-19 14:54:36,418 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1679237675154; duration=1sec 2023-03-19 14:54:36,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:36,418 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:36,425 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/0ac82e4d4a5a4a8fadd1f94ea3a10ab9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/6013eff7670b436a8f46f46f64c16352, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/1502541282c94396abbedf0b2ad2d286_SeqId_47_] to archive 2023-03-19 14:54:36,426 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:36,429 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/0ac82e4d4a5a4a8fadd1f94ea3a10ab9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/0ac82e4d4a5a4a8fadd1f94ea3a10ab9 2023-03-19 14:54:36,430 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/6013eff7670b436a8f46f46f64c16352 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/6013eff7670b436a8f46f46f64c16352 2023-03-19 14:54:36,432 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/1502541282c94396abbedf0b2ad2d286_SeqId_47_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/1502541282c94396abbedf0b2ad2d286_SeqId_47_ 2023-03-19 14:54:36,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-19 14:54:36,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:36,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:36,438 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 525b5eabd1937cfff55f6add30c5ff56 to self. 2023-03-19 14:54:36,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:36,440 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=525b5eabd1937cfff55f6add30c5ff56, regionState=CLOSED 2023-03-19 14:54:36,440 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237676440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237676440"}]},"ts":"1679237676440"} 2023-03-19 14:54:36,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-19 14:54:36,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 525b5eabd1937cfff55f6add30c5ff56, server=jenkins-hbase20.apache.org,33191,1679237584457 in 791 msec 2023-03-19 14:54:36,443 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=true 2023-03-19 14:54:36,594 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=525b5eabd1937cfff55f6add30c5ff56, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:36,594 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237676594"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237676594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237676594"}]},"ts":"1679237676594"} 2023-03-19 14:54:36,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 525b5eabd1937cfff55f6add30c5ff56, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:36,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:36,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 525b5eabd1937cfff55f6add30c5ff56, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:54:36,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:36,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:36,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:36,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:36,758 INFO [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:36,760 DEBUG [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:36,760 DEBUG [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:36,761 INFO [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 525b5eabd1937cfff55f6add30c5ff56 columnFamilyName family1 2023-03-19 14:54:36,770 DEBUG [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/e7a37b8a1bce47d086651bd005220900 2023-03-19 14:54:36,770 INFO [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] regionserver.HStore(310): Store=525b5eabd1937cfff55f6add30c5ff56/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:36,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:36,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:36,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:36,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 525b5eabd1937cfff55f6add30c5ff56; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70135334, jitterRate=0.045097917318344116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:54:36,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:36,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56., pid=63, masterSystemTime=1679237676751 2023-03-19 14:54:36,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:36,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:36,785 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=525b5eabd1937cfff55f6add30c5ff56, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:36,785 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237676785"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237676785"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237676785"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237676785"}]},"ts":"1679237676785"} 2023-03-19 14:54:36,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-19 14:54:36,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 525b5eabd1937cfff55f6add30c5ff56, server=jenkins-hbase20.apache.org,33191,1679237584457 in 190 msec 2023-03-19 14:54:36,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-19 14:54:36,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, REOPEN/MOVE in 1.1420 sec 2023-03-19 14:54:36,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-19 14:54:36,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1480 sec 2023-03-19 14:54:36,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5650 sec 2023-03-19 14:54:36,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-19 14:54:36,797 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(278): alter status finished 2023-03-19 14:54:36,798 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:36,799 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-19 14:54:36,800 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-19 14:54:36,800 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:36,800 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238276800 2023-03-19 14:54:36,801 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:54:36,801 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-19 14:54:36,801 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:36,802 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x1068f199 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:54:36,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76dd5c58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:54:36,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:36,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:36,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:36,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:36,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:37,633 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284291ffe2bf2a4886b50bcda3972f6846 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284291ffe2bf2a4886b50bcda3972f6846 2023-03-19 14:54:37,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:37,644 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:54:37,645 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38114, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:54:37,651 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:54:37,653 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47136, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:54:37,661 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b291e06354244d8b03ae55a690025b6 first=Optional[r05] last=Optional[r8] 2023-03-19 14:54:37,661 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b291e06354244d8b03ae55a690025b6}] 2023-03-19 14:54:37,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b291e06354244d8b03ae55a690025b6 for inclusion in 525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:37,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-19 14:54:37,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:54:37,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:37,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6b291e06354244d8b03ae55a690025b6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r3l61i1lseuv8081gj64d6uoav5fp6evi12kjvmq5ttsqvdspjjdhdk3aeoto4tu/family1/6b291e06354244d8b03ae55a690025b6 2023-03-19 14:54:37,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r3l61i1lseuv8081gj64d6uoav5fp6evi12kjvmq5ttsqvdspjjdhdk3aeoto4tu/family1/6b291e06354244d8b03ae55a690025b6 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/5763b82c38e7498eaa228b09c444400f_SeqId_53_ 2023-03-19 14:54:37,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r3l61i1lseuv8081gj64d6uoav5fp6evi12kjvmq5ttsqvdspjjdhdk3aeoto4tu/family1/6b291e06354244d8b03ae55a690025b6 into 525b5eabd1937cfff55f6add30c5ff56/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/5763b82c38e7498eaa228b09c444400f_SeqId_53_ - updating store file list. 2023-03-19 14:54:37,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/5763b82c38e7498eaa228b09c444400f_SeqId_53_ into 525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:37,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r3l61i1lseuv8081gj64d6uoav5fp6evi12kjvmq5ttsqvdspjjdhdk3aeoto4tu/family1/6b291e06354244d8b03ae55a690025b6 into 525b5eabd1937cfff55f6add30c5ff56/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/5763b82c38e7498eaa228b09c444400f_SeqId_53_) 2023-03-19 14:54:37,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__r3l61i1lseuv8081gj64d6uoav5fp6evi12kjvmq5ttsqvdspjjdhdk3aeoto4tu/family1/6b291e06354244d8b03ae55a690025b6 2023-03-19 14:54:37,679 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:37,679 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:37,681 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511204bd9805f4ad440378bcf156e106ff5b4 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511204bd9805f4ad440378bcf156e106ff5b4 2023-03-19 14:54:37,681 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285c4c50d90210426f95bd8c7f77273cad to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511285c4c50d90210426f95bd8c7f77273cad 2023-03-19 14:54:37,681 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-19 14:54:37,681 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-19 14:54:37,682 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:37,682 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:37,682 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:37,682 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:37,682 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:37,683 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-19 14:54:37,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 885 msec 2023-03-19 14:54:37,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-19 14:54:37,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:38,140 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-19 14:54:38,143 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-19 14:54:38,143 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-19 14:54:38,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-19 14:54:38,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, REOPEN/MOVE}] 2023-03-19 14:54:38,150 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, REOPEN/MOVE 2023-03-19 14:54:38,150 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=525b5eabd1937cfff55f6add30c5ff56, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:38,151 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237678150"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237678150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237678150"}]},"ts":"1679237678150"} 2023-03-19 14:54:38,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 525b5eabd1937cfff55f6add30c5ff56, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:38,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:38,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 525b5eabd1937cfff55f6add30c5ff56, disabling compactions & flushes 2023-03-19 14:54:38,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:38,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:38,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. after waiting 0 ms 2023-03-19 14:54:38,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:38,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-19 14:54:38,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:38,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:38,319 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 525b5eabd1937cfff55f6add30c5ff56 to self. 2023-03-19 14:54:38,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:38,321 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=525b5eabd1937cfff55f6add30c5ff56, regionState=CLOSED 2023-03-19 14:54:38,321 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237678321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237678321"}]},"ts":"1679237678321"} 2023-03-19 14:54:38,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-19 14:54:38,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 525b5eabd1937cfff55f6add30c5ff56, server=jenkins-hbase20.apache.org,33191,1679237584457 in 170 msec 2023-03-19 14:54:38,324 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=true 2023-03-19 14:54:38,475 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=525b5eabd1937cfff55f6add30c5ff56, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:38,475 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237678475"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237678475"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237678475"}]},"ts":"1679237678475"} 2023-03-19 14:54:38,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 525b5eabd1937cfff55f6add30c5ff56, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:38,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:38,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 525b5eabd1937cfff55f6add30c5ff56, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:54:38,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:38,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:38,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:38,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:38,645 INFO [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:38,648 DEBUG [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:38,648 DEBUG [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1 2023-03-19 14:54:38,649 INFO [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 525b5eabd1937cfff55f6add30c5ff56 columnFamilyName family1 2023-03-19 14:54:38,656 DEBUG [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/5763b82c38e7498eaa228b09c444400f_SeqId_53_ 2023-03-19 14:54:38,661 DEBUG [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/family1/e7a37b8a1bce47d086651bd005220900 2023-03-19 14:54:38,661 INFO [StoreOpener-525b5eabd1937cfff55f6add30c5ff56-1] regionserver.HStore(310): Store=525b5eabd1937cfff55f6add30c5ff56/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:38,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:38,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:38,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:54:38,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 525b5eabd1937cfff55f6add30c5ff56; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61689267, jitterRate=-0.08075828850269318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:54:38,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:54:38,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56., pid=69, masterSystemTime=1679237678633 2023-03-19 14:54:38,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:38,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:54:38,671 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=525b5eabd1937cfff55f6add30c5ff56, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:38,671 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1679237678671"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237678671"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237678671"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237678671"}]},"ts":"1679237678671"} 2023-03-19 14:54:38,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-19 14:54:38,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 525b5eabd1937cfff55f6add30c5ff56, server=jenkins-hbase20.apache.org,33191,1679237584457 in 193 msec 2023-03-19 14:54:38,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-19 14:54:38,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=525b5eabd1937cfff55f6add30c5ff56, REOPEN/MOVE in 525 msec 2023-03-19 14:54:38,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-19 14:54:38,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 529 msec 2023-03-19 14:54:38,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 950 msec 2023-03-19 14:54:38,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-19 14:54:38,681 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(278): alter status finished 2023-03-19 14:54:38,682 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-19 14:54:38,683 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-19 14:54:38,683 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-19 14:54:38,684 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:38,684 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238278684 2023-03-19 14:54:38,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:54:38,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-19 14:54:38,685 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:38,686 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x6ea94a71 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:54:38,689 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d58cad7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:54:38,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:38,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:38,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:38,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:38,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:38,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:38,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:38,690 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-19 14:54:38,690 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-19 14:54:38,690 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:38,691 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-19 14:54:38,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-03-19 14:54:38,737 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=240 (was 246), OpenFileDescriptor=617 (was 625), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=223 (was 256), ProcessCount=168 (was 168), AvailableMemoryMB=4222 (was 4270) 2023-03-19 14:54:38,747 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=240, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=223, ProcessCount=168, AvailableMemoryMB=4222 2023-03-19 14:54:38,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-19 14:54:38,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-19 14:54:38,753 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:54:38,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-19 14:54:38,753 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:54:38,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-19 14:54:38,754 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:38,755 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7 empty. 2023-03-19 14:54:38,755 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:38,755 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-19 14:54:38,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-19 14:54:39,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-19 14:54:39,163 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-19 14:54:39,165 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 79b1c18bbea5c24b8458080765c2dcb7, NAME => 'testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:54:39,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-19 14:54:39,573 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:39,573 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 79b1c18bbea5c24b8458080765c2dcb7, disabling compactions & flushes 2023-03-19 14:54:39,573 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:39,573 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:39,574 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. after waiting 0 ms 2023-03-19 14:54:39,574 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:39,574 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:39,574 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 79b1c18bbea5c24b8458080765c2dcb7: 2023-03-19 14:54:39,580 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:54:39,582 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679237679582"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237679582"}]},"ts":"1679237679582"} 2023-03-19 14:54:39,584 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-19 14:54:39,584 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:54:39,585 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237679585"}]},"ts":"1679237679585"} 2023-03-19 14:54:39,586 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-19 14:54:39,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=79b1c18bbea5c24b8458080765c2dcb7, ASSIGN}] 2023-03-19 14:54:39,590 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=79b1c18bbea5c24b8458080765c2dcb7, ASSIGN 2023-03-19 14:54:39,591 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=79b1c18bbea5c24b8458080765c2dcb7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:54:39,742 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=79b1c18bbea5c24b8458080765c2dcb7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:39,743 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679237679742"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237679742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237679742"}]},"ts":"1679237679742"} 2023-03-19 14:54:39,745 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 79b1c18bbea5c24b8458080765c2dcb7, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:39,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-19 14:54:39,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:39,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79b1c18bbea5c24b8458080765c2dcb7, NAME => 'testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:54:39,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-19 14:54:39,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-19 14:54:39,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:39,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:39,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:39,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:39,912 INFO [StoreOpener-79b1c18bbea5c24b8458080765c2dcb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:39,914 DEBUG [StoreOpener-79b1c18bbea5c24b8458080765c2dcb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1 2023-03-19 14:54:39,915 DEBUG [StoreOpener-79b1c18bbea5c24b8458080765c2dcb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1 2023-03-19 14:54:39,915 INFO [StoreOpener-79b1c18bbea5c24b8458080765c2dcb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79b1c18bbea5c24b8458080765c2dcb7 columnFamilyName f1 2023-03-19 14:54:39,917 INFO [StoreOpener-79b1c18bbea5c24b8458080765c2dcb7-1] regionserver.HStore(310): Store=79b1c18bbea5c24b8458080765c2dcb7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:39,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:39,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:39,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:39,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:54:39,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 79b1c18bbea5c24b8458080765c2dcb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70938664, jitterRate=0.057068467140197754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:54:39,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 79b1c18bbea5c24b8458080765c2dcb7: 2023-03-19 14:54:39,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7., pid=73, masterSystemTime=1679237679897 2023-03-19 14:54:39,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:39,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:39,928 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=79b1c18bbea5c24b8458080765c2dcb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:39,928 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679237679928"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237679928"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237679928"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237679928"}]},"ts":"1679237679928"} 2023-03-19 14:54:39,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-19 14:54:39,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 79b1c18bbea5c24b8458080765c2dcb7, server=jenkins-hbase20.apache.org,33191,1679237584457 in 185 msec 2023-03-19 14:54:39,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-19 14:54:39,934 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=79b1c18bbea5c24b8458080765c2dcb7, ASSIGN in 344 msec 2023-03-19 14:54:39,934 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:54:39,935 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237679935"}]},"ts":"1679237679935"} 2023-03-19 14:54:39,936 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-19 14:54:39,938 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:54:39,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1870 sec 2023-03-19 14:54:40,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-19 14:54:40,864 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-19 14:54:40,864 DEBUG [Listener at localhost.localdomain/46521] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-19 14:54:40,869 INFO [Listener at localhost.localdomain/46521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-19 14:54:40,876 INFO [Listener at localhost.localdomain/46521] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-19 14:54:40,876 INFO [Listener at localhost.localdomain/46521] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-19 14:54:40,876 INFO [Listener at localhost.localdomain/46521] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-19 14:54:40,881 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2745): Flushing 79b1c18bbea5c24b8458080765c2dcb7 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-19 14:54:41,299 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303197b1a12365cfc4682b6310df3a02c3731 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303197b1a12365cfc4682b6310df3a02c3731 2023-03-19 14:54:41,706 INFO [Listener at localhost.localdomain/46521] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/.tmp/f1/aee4173eea6b4d0f959609115aa0b138 2023-03-19 14:54:41,712 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/.tmp/f1/aee4173eea6b4d0f959609115aa0b138 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138 2023-03-19 14:54:41,717 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138, entries=1, sequenceid=5, filesize=4.9 K 2023-03-19 14:54:41,718 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 79b1c18bbea5c24b8458080765c2dcb7 in 837ms, sequenceid=5, compaction requested=false 2023-03-19 14:54:41,718 DEBUG [Listener at localhost.localdomain/46521] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-19 14:54:41,719 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2446): Flush status journal for 79b1c18bbea5c24b8458080765c2dcb7: 2023-03-19 14:54:41,721 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2745): Flushing 79b1c18bbea5c24b8458080765c2dcb7 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-19 14:54:41,974 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:54:42,139 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031917b9c6f77d0e46e9b991b3c2bc10d73e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031917b9c6f77d0e46e9b991b3c2bc10d73e 2023-03-19 14:54:42,548 INFO [Listener at localhost.localdomain/46521] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/.tmp/f1/c674dd66c01f4cbfbe547fe28f330a9a 2023-03-19 14:54:42,560 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/.tmp/f1/c674dd66c01f4cbfbe547fe28f330a9a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a 2023-03-19 14:54:42,566 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a, entries=1, sequenceid=9, filesize=4.9 K 2023-03-19 14:54:42,567 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 79b1c18bbea5c24b8458080765c2dcb7 in 846ms, sequenceid=9, compaction requested=false 2023-03-19 14:54:42,567 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2446): Flush status journal for 79b1c18bbea5c24b8458080765c2dcb7: 2023-03-19 14:54:42,568 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-19 14:54:42,570 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-19 14:54:42,571 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-19 14:54:42,571 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:42,571 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238282571 2023-03-19 14:54:42,572 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-19 14:54:42,572 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-19 14:54:42,572 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-19 14:54:42,573 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x48028d80 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:54:42,576 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6327f825, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:54:42,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230319 for table='testGetAfterCompaction' and column='f1' 2023-03-19 14:54:42,620 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,620 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,649 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-19 14:54:42,671 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,671 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,722 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,722 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,774 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,774 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,825 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,826 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,877 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,878 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,929 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,929 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,981 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:42,981 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,032 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,032 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,084 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,084 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,136 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,137 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,188 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,188 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,239 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,239 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,290 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,290 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,342 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,342 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,394 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,394 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,414 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031958b618827e594abda46f97381792412b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031958b618827e594abda46f97381792412b 2023-03-19 14:54:43,415 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230319 table='testGetAfterCompaction' column='f1' 2023-03-19 14:54:43,425 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:54:43,426 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51336, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:54:43,432 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:54:43,434 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:54:43,442 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230319/f1/a456bd0a06fa421a930ce6e4702f70dc first=Optional[r1] last=Optional[r2] 2023-03-19 14:54:43,443 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230319/f1/a456bd0a06fa421a930ce6e4702f70dc}] 2023-03-19 14:54:43,445 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,445 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230319/f1/a456bd0a06fa421a930ce6e4702f70dc for inclusion in 79b1c18bbea5c24b8458080765c2dcb7/f1 2023-03-19 14:54:43,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-19 14:54:43,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:54:43,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 79b1c18bbea5c24b8458080765c2dcb7: 2023-03-19 14:54:43,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230319/f1/a456bd0a06fa421a930ce6e4702f70dc to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testGetAfterCompaction__jr2ol75l6br93c7119uoinir25ajhknr33ps3mmv6tck3q9d1sd28chtdj549tan/f1/a456bd0a06fa421a930ce6e4702f70dc 2023-03-19 14:54:43,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testGetAfterCompaction__jr2ol75l6br93c7119uoinir25ajhknr33ps3mmv6tck3q9d1sd28chtdj549tan/f1/a456bd0a06fa421a930ce6e4702f70dc as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_ 2023-03-19 14:54:43,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testGetAfterCompaction__jr2ol75l6br93c7119uoinir25ajhknr33ps3mmv6tck3q9d1sd28chtdj549tan/f1/a456bd0a06fa421a930ce6e4702f70dc into 79b1c18bbea5c24b8458080765c2dcb7/f1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_ - updating store file list. 2023-03-19 14:54:43,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_ into 79b1c18bbea5c24b8458080765c2dcb7/f1 2023-03-19 14:54:43,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testGetAfterCompaction__jr2ol75l6br93c7119uoinir25ajhknr33ps3mmv6tck3q9d1sd28chtdj549tan/f1/a456bd0a06fa421a930ce6e4702f70dc into 79b1c18bbea5c24b8458080765c2dcb7/f1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_) 2023-03-19 14:54:43,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testGetAfterCompaction__jr2ol75l6br93c7119uoinir25ajhknr33ps3mmv6tck3q9d1sd28chtdj549tan/f1/a456bd0a06fa421a930ce6e4702f70dc 2023-03-19 14:54:43,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(1912): 79b1c18bbea5c24b8458080765c2dcb7/f1 is initiating minor compaction 2023-03-19 14:54:43,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@c933cef; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-19 14:54:43,459 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 79b1c18bbea5c24b8458080765c2dcb7/f1 in testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:43,460 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/.tmp, totalSize=10.0 K 2023-03-19 14:54:43,460 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting c674dd66c01f4cbfbe547fe28f330a9a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-19 14:54:43,460 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-19 14:54:43,461 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230319 table='testGetAfterCompaction' column='f1' 2023-03-19 14:54:43,462 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:43,463 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-19 14:54:43,463 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-03-19 14:54:43,464 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031917b9c6f77d0e46e9b991b3c2bc10d73e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031917b9c6f77d0e46e9b991b3c2bc10d73e 2023-03-19 14:54:43,465 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303197b1a12365cfc4682b6310df3a02c3731 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202303197b1a12365cfc4682b6310df3a02c3731 2023-03-19 14:54:43,465 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-19 14:54:43,465 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230319' 2023-03-19 14:54:43,465 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230319 for table='testGetAfterCompaction' and column='f1' 2023-03-19 14:54:43,465 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-19 14:54:43,465 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:54:43,467 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-19 14:54:43,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 898 msec 2023-03-19 14:54:43,468 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 79b1c18bbea5c24b8458080765c2dcb7#f1#compaction#77 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:54:43,496 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:43,497 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,497 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,503 DEBUG [Listener at localhost.localdomain/46521] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-19 14:54:43,508 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51348, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-19 14:54:43,508 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33191] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:43,509 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-19 14:54:43,509 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-19 14:54:43,510 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33191] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-19 14:54:43,510 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33191] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. because compaction request was cancelled 2023-03-19 14:54:43,562 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:43,562 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,562 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,613 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:43,614 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,614 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,665 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:43,665 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,666 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,717 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:43,718 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,718 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,770 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:43,770 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,770 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,822 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:43,822 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,822 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,874 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:43,875 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,875 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,926 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:43,926 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,926 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,977 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:43,978 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:43,978 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,029 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:44,029 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,029 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,080 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:44,081 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,081 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,132 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:44,132 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,132 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,183 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:44,183 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,183 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,234 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:44,235 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,235 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,286 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:44,287 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,287 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,303 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/.tmp/f1/42cb28b935a045e7a368b330cb302ad3 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/42cb28b935a045e7a368b330cb302ad3 2023-03-19 14:54:44,311 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 79b1c18bbea5c24b8458080765c2dcb7/f1 of 79b1c18bbea5c24b8458080765c2dcb7 into 42cb28b935a045e7a368b330cb302ad3(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:54:44,311 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 79b1c18bbea5c24b8458080765c2dcb7: 2023-03-19 14:54:44,311 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1679237683459; duration=0sec 2023-03-19 14:54:44,311 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:54:44,338 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/42cb28b935a045e7a368b330cb302ad3; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1679237684287; access_time=1679237683465; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,338 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1679237683402; access_time=1679237682587; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-19 14:54:44,338 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,339 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237682547; access_time=1679237681724; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_] to archive 2023-03-19 14:54:44,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:54:44,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/c674dd66c01f4cbfbe547fe28f330a9a 2023-03-19 14:54:44,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/5e2910b14e9d4b7f82cb3ce406d300f6_SeqId_12_ 2023-03-19 14:54:44,390 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/42cb28b935a045e7a368b330cb302ad3; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1679237684287; access_time=1679237683465; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,390 INFO [Listener at localhost.localdomain/46521] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1679237681705; access_time=1679237680883; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-19 14:54:44,516 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-19 14:54:44,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-03-19 14:54:44,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-19 14:54:44,532 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237684531"}]},"ts":"1679237684531"} 2023-03-19 14:54:44,533 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-19 14:54:44,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-19 14:54:44,534 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-19 14:54:44,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=79b1c18bbea5c24b8458080765c2dcb7, UNASSIGN}] 2023-03-19 14:54:44,536 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=79b1c18bbea5c24b8458080765c2dcb7, UNASSIGN 2023-03-19 14:54:44,537 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=79b1c18bbea5c24b8458080765c2dcb7, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:44,537 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679237684537"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237684537"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237684537"}]},"ts":"1679237684537"} 2023-03-19 14:54:44,538 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 79b1c18bbea5c24b8458080765c2dcb7, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:44,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-19 14:54:44,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 79b1c18bbea5c24b8458080765c2dcb7, disabling compactions & flushes 2023-03-19 14:54:44,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. after waiting 0 ms 2023-03-19 14:54:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:44,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-19 14:54:44,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-19 14:54:44,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7. 2023-03-19 14:54:44,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 79b1c18bbea5c24b8458080765c2dcb7: 2023-03-19 14:54:44,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:44,707 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=79b1c18bbea5c24b8458080765c2dcb7, regionState=CLOSED 2023-03-19 14:54:44,707 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1679237684707"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237684707"}]},"ts":"1679237684707"} 2023-03-19 14:54:44,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-19 14:54:44,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 79b1c18bbea5c24b8458080765c2dcb7, server=jenkins-hbase20.apache.org,33191,1679237584457 in 170 msec 2023-03-19 14:54:44,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-19 14:54:44,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=79b1c18bbea5c24b8458080765c2dcb7, UNASSIGN in 176 msec 2023-03-19 14:54:44,713 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237684713"}]},"ts":"1679237684713"} 2023-03-19 14:54:44,715 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-19 14:54:44,716 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-19 14:54:44,717 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 193 msec 2023-03-19 14:54:44,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-19 14:54:44,836 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-19 14:54:44,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-03-19 14:54:44,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-19 14:54:44,853 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-19 14:54:44,854 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-19 14:54:44,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-19 14:54:44,858 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:44,860 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1, FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/recovered.edits] 2023-03-19 14:54:44,864 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/42cb28b935a045e7a368b330cb302ad3 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/42cb28b935a045e7a368b330cb302ad3 2023-03-19 14:54:44,865 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/f1/aee4173eea6b4d0f959609115aa0b138 2023-03-19 14:54:44,868 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/recovered.edits/15.seqid to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7/recovered.edits/15.seqid 2023-03-19 14:54:44,868 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testGetAfterCompaction/79b1c18bbea5c24b8458080765c2dcb7 2023-03-19 14:54:44,868 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-19 14:54:44,869 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-19 14:54:44,870 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-19 14:54:44,874 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031958b618827e594abda46f97381792412b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023031958b618827e594abda46f97381792412b 2023-03-19 14:54:44,874 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-19 14:54:44,877 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-19 14:54:44,898 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-19 14:54:44,901 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-19 14:54:44,902 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-19 14:54:44,902 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-19 14:54:44,902 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679237684902"}]},"ts":"9223372036854775807"} 2023-03-19 14:54:44,903 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-19 14:54:44,903 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 79b1c18bbea5c24b8458080765c2dcb7, NAME => 'testGetAfterCompaction,,1679237678750.79b1c18bbea5c24b8458080765c2dcb7.', STARTKEY => '', ENDKEY => ''}] 2023-03-19 14:54:44,903 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-19 14:54:44,903 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1679237684903"}]},"ts":"9223372036854775807"} 2023-03-19 14:54:44,905 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-19 14:54:44,906 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-19 14:54:44,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 62 msec 2023-03-19 14:54:44,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-19 14:54:44,957 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-19 14:54:44,971 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=243 (was 240) - Thread LEAK? -, OpenFileDescriptor=607 (was 617), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 223), ProcessCount=168 (was 168), AvailableMemoryMB=4219 (was 4222) 2023-03-19 14:54:44,981 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=243, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=189, ProcessCount=168, AvailableMemoryMB=4219 2023-03-19 14:54:44,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-19 14:54:44,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-19 14:54:44,985 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:54:44,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-19 14:54:44,986 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:54:44,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-19 14:54:44,987 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:54:44,988 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:54:44,988 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc empty. 2023-03-19 14:54:44,988 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f 2023-03-19 14:54:44,988 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b empty. 2023-03-19 14:54:44,989 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:54:44,989 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f empty. 2023-03-19 14:54:44,989 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:54:44,989 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f 2023-03-19 14:54:44,989 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-19 14:54:45,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-19 14:54:45,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-19 14:54:45,398 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-19 14:54:45,400 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => f8e8d7cf2c5e169edcb3b943f53497bc, NAME => 'testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:54:45,401 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => affcc240214c2740e267f2d65797302f, NAME => 'testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:54:45,401 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9aa1fc0f1990ce625d14a4ce4d80764b, NAME => 'testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:54:45,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-19 14:54:45,812 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:45,812 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:45,812 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing affcc240214c2740e267f2d65797302f, disabling compactions & flushes 2023-03-19 14:54:45,812 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing f8e8d7cf2c5e169edcb3b943f53497bc, disabling compactions & flushes 2023-03-19 14:54:45,813 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:45,813 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:45,813 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. after waiting 0 ms 2023-03-19 14:54:45,812 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:45,813 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:45,813 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:45,813 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. after waiting 0 ms 2023-03-19 14:54:45,813 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:45,813 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:54:45,813 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:45,813 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:45,813 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:54:45,813 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:45,813 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 9aa1fc0f1990ce625d14a4ce4d80764b, disabling compactions & flushes 2023-03-19 14:54:45,814 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:45,814 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:45,814 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. after waiting 0 ms 2023-03-19 14:54:45,814 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:45,814 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:45,814 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:54:45,817 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:54:45,819 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237685819"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237685819"}]},"ts":"1679237685819"} 2023-03-19 14:54:45,819 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237685819"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237685819"}]},"ts":"1679237685819"} 2023-03-19 14:54:45,819 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237685819"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237685819"}]},"ts":"1679237685819"} 2023-03-19 14:54:45,822 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-19 14:54:45,823 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:54:45,823 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237685823"}]},"ts":"1679237685823"} 2023-03-19 14:54:45,825 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-19 14:54:45,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, ASSIGN}] 2023-03-19 14:54:45,830 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, ASSIGN 2023-03-19 14:54:45,830 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, ASSIGN 2023-03-19 14:54:45,830 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, ASSIGN 2023-03-19 14:54:45,831 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:54:45,831 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:54:45,831 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:54:45,983 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=affcc240214c2740e267f2d65797302f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:45,983 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9aa1fc0f1990ce625d14a4ce4d80764b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:45,983 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f8e8d7cf2c5e169edcb3b943f53497bc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:45,984 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237685983"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237685983"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237685983"}]},"ts":"1679237685983"} 2023-03-19 14:54:45,984 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237685983"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237685983"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237685983"}]},"ts":"1679237685983"} 2023-03-19 14:54:45,984 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237685983"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237685983"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237685983"}]},"ts":"1679237685983"} 2023-03-19 14:54:45,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 9aa1fc0f1990ce625d14a4ce4d80764b, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:45,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure f8e8d7cf2c5e169edcb3b943f53497bc, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:45,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure affcc240214c2740e267f2d65797302f, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:54:46,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-19 14:54:46,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:46,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => affcc240214c2740e267f2d65797302f, NAME => 'testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.', STARTKEY => '2', ENDKEY => ''} 2023-03-19 14:54:46,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink affcc240214c2740e267f2d65797302f 2023-03-19 14:54:46,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:46,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for affcc240214c2740e267f2d65797302f 2023-03-19 14:54:46,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for affcc240214c2740e267f2d65797302f 2023-03-19 14:54:46,148 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region affcc240214c2740e267f2d65797302f 2023-03-19 14:54:46,150 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1 2023-03-19 14:54:46,150 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1 2023-03-19 14:54:46,151 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region affcc240214c2740e267f2d65797302f columnFamilyName family1 2023-03-19 14:54:46,153 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(310): Store=affcc240214c2740e267f2d65797302f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:46,153 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region affcc240214c2740e267f2d65797302f 2023-03-19 14:54:46,155 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2 2023-03-19 14:54:46,155 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2 2023-03-19 14:54:46,155 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region affcc240214c2740e267f2d65797302f columnFamilyName family2 2023-03-19 14:54:46,157 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(310): Store=affcc240214c2740e267f2d65797302f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:46,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f 2023-03-19 14:54:46,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f 2023-03-19 14:54:46,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:54:46,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for affcc240214c2740e267f2d65797302f 2023-03-19 14:54:46,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:54:46,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened affcc240214c2740e267f2d65797302f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67555767, jitterRate=0.006659373641014099}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:54:46,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:54:46,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f., pid=85, masterSystemTime=1679237686140 2023-03-19 14:54:46,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:46,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:46,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:46,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9aa1fc0f1990ce625d14a4ce4d80764b, NAME => 'testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.', STARTKEY => '1', ENDKEY => '2'} 2023-03-19 14:54:46,169 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=affcc240214c2740e267f2d65797302f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:46,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:54:46,169 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237686169"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237686169"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237686169"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237686169"}]},"ts":"1679237686169"} 2023-03-19 14:54:46,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:46,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:54:46,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:54:46,171 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:54:46,172 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1 2023-03-19 14:54:46,172 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1 2023-03-19 14:54:46,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-03-19 14:54:46,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure affcc240214c2740e267f2d65797302f, server=jenkins-hbase20.apache.org,33191,1679237584457 in 183 msec 2023-03-19 14:54:46,173 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aa1fc0f1990ce625d14a4ce4d80764b columnFamilyName family1 2023-03-19 14:54:46,173 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, ASSIGN in 344 msec 2023-03-19 14:54:46,174 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(310): Store=9aa1fc0f1990ce625d14a4ce4d80764b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:46,174 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:54:46,176 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2 2023-03-19 14:54:46,176 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2 2023-03-19 14:54:46,176 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aa1fc0f1990ce625d14a4ce4d80764b columnFamilyName family2 2023-03-19 14:54:46,177 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(310): Store=9aa1fc0f1990ce625d14a4ce4d80764b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:46,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:54:46,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:54:46,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:54:46,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:54:46,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:54:46,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9aa1fc0f1990ce625d14a4ce4d80764b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60602996, jitterRate=-0.09694498777389526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:54:46,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:54:46,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b., pid=83, masterSystemTime=1679237686140 2023-03-19 14:54:46,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:46,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:46,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:46,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f8e8d7cf2c5e169edcb3b943f53497bc, NAME => 'testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.', STARTKEY => '', ENDKEY => '1'} 2023-03-19 14:54:46,189 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9aa1fc0f1990ce625d14a4ce4d80764b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:46,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:54:46,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:54:46,189 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237686188"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237686188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237686188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237686188"}]},"ts":"1679237686188"} 2023-03-19 14:54:46,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:54:46,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:54:46,191 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:54:46,192 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1 2023-03-19 14:54:46,192 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1 2023-03-19 14:54:46,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-03-19 14:54:46,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 9aa1fc0f1990ce625d14a4ce4d80764b, server=jenkins-hbase20.apache.org,33191,1679237584457 in 205 msec 2023-03-19 14:54:46,193 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e8d7cf2c5e169edcb3b943f53497bc columnFamilyName family1 2023-03-19 14:54:46,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, ASSIGN in 366 msec 2023-03-19 14:54:46,194 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(310): Store=f8e8d7cf2c5e169edcb3b943f53497bc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:46,194 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:54:46,196 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2 2023-03-19 14:54:46,196 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2 2023-03-19 14:54:46,196 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e8d7cf2c5e169edcb3b943f53497bc columnFamilyName family2 2023-03-19 14:54:46,197 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(310): Store=f8e8d7cf2c5e169edcb3b943f53497bc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:54:46,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:54:46,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:54:46,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:54:46,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:54:46,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:54:46,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f8e8d7cf2c5e169edcb3b943f53497bc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62472018, jitterRate=-0.06909438967704773}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:54:46,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:54:46,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc., pid=84, masterSystemTime=1679237686140 2023-03-19 14:54:46,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:46,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:46,205 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f8e8d7cf2c5e169edcb3b943f53497bc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:46,206 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237686205"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237686205"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237686205"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237686205"}]},"ts":"1679237686205"} 2023-03-19 14:54:46,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=80 2023-03-19 14:54:46,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure f8e8d7cf2c5e169edcb3b943f53497bc, server=jenkins-hbase20.apache.org,33191,1679237584457 in 220 msec 2023-03-19 14:54:46,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-03-19 14:54:46,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, ASSIGN in 382 msec 2023-03-19 14:54:46,212 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:54:46,212 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237686212"}]},"ts":"1679237686212"} 2023-03-19 14:54:46,213 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-19 14:54:46,216 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:54:46,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2330 sec 2023-03-19 14:54:47,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-19 14:54:47,096 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-19 14:54:47,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:47,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:47,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:47,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:47,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-19 14:54:47,114 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-19 14:54:47,114 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:47,114 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-19 14:54:47,114 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-19 14:54:47,114 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:47,114 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:47,115 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:47,115 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:47,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:47,115 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:47,115 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:47,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:47,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:47,116 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-19 14:54:47,116 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-19 14:54:47,117 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-19 14:54:47,117 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:47,117 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-19 14:54:47,117 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:47,117 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. started... 2023-03-19 14:54:47,117 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:47,117 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:54:47,118 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:47,117 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. started... 2023-03-19 14:54:47,118 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing affcc240214c2740e267f2d65797302f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-19 14:54:47,118 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9aa1fc0f1990ce625d14a4ce4d80764b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-19 14:54:47,118 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:47,118 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. started... 2023-03-19 14:54:47,119 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f8e8d7cf2c5e169edcb3b943f53497bc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-19 14:54:47,540 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319614dfba9fb484c17b78e7e0af5487225 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230319614dfba9fb484c17b78e7e0af5487225 2023-03-19 14:54:47,540 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319a445dc1c66df4f1b8f2f2e675e7a98ac to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319a445dc1c66df4f1b8f2f2e675e7a98ac 2023-03-19 14:54:47,541 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319313c4a0385ba497c82db271515476776 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319313c4a0385ba497c82db271515476776 2023-03-19 14:54:47,946 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/cc44908f6c5e427a90a6ca32334cf79e 2023-03-19 14:54:47,947 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/b8be95693f2a440380270ed0b7987057 2023-03-19 14:54:47,947 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/3135a14f577e414b895c137eda08f073 2023-03-19 14:54:48,376 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319437c17dffd754379aef4dc8fb0a91269 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230319437c17dffd754379aef4dc8fb0a91269 2023-03-19 14:54:48,376 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031968235407d2b24f0d994b5825317eb9d9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031968235407d2b24f0d994b5825317eb9d9 2023-03-19 14:54:48,376 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303198a8ee595b9454d75a72ae4dc55785002 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303198a8ee595b9454d75a72ae4dc55785002 2023-03-19 14:54:48,651 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-19 14:54:48,788 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/fc2b5d5467204a3083e136b8718bf3e2 2023-03-19 14:54:48,788 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/2ef2f161f72b4885be16d467c2d07fee 2023-03-19 14:54:48,789 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/71b438b29ca74f3faa56c09a9678e0d7 2023-03-19 14:54:48,797 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/cc44908f6c5e427a90a6ca32334cf79e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/cc44908f6c5e427a90a6ca32334cf79e 2023-03-19 14:54:48,797 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/b8be95693f2a440380270ed0b7987057 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/b8be95693f2a440380270ed0b7987057 2023-03-19 14:54:48,797 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/3135a14f577e414b895c137eda08f073 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/3135a14f577e414b895c137eda08f073 2023-03-19 14:54:48,801 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/cc44908f6c5e427a90a6ca32334cf79e, entries=4, sequenceid=5, filesize=5.4 K 2023-03-19 14:54:48,801 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/b8be95693f2a440380270ed0b7987057, entries=4, sequenceid=5, filesize=5.4 K 2023-03-19 14:54:48,801 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/3135a14f577e414b895c137eda08f073, entries=4, sequenceid=5, filesize=5.4 K 2023-03-19 14:54:48,802 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/71b438b29ca74f3faa56c09a9678e0d7 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/71b438b29ca74f3faa56c09a9678e0d7 2023-03-19 14:54:48,802 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/2ef2f161f72b4885be16d467c2d07fee as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2ef2f161f72b4885be16d467c2d07fee 2023-03-19 14:54:48,802 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/fc2b5d5467204a3083e136b8718bf3e2 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/fc2b5d5467204a3083e136b8718bf3e2 2023-03-19 14:54:48,806 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/71b438b29ca74f3faa56c09a9678e0d7, entries=2, sequenceid=5, filesize=5.1 K 2023-03-19 14:54:48,806 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/fc2b5d5467204a3083e136b8718bf3e2, entries=2, sequenceid=5, filesize=5.1 K 2023-03-19 14:54:48,806 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2ef2f161f72b4885be16d467c2d07fee, entries=2, sequenceid=5, filesize=5.1 K 2023-03-19 14:54:48,807 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9aa1fc0f1990ce625d14a4ce4d80764b in 1689ms, sequenceid=5, compaction requested=false 2023-03-19 14:54:48,807 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for affcc240214c2740e267f2d65797302f in 1689ms, sequenceid=5, compaction requested=false 2023-03-19 14:54:48,807 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:54:48,807 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:54:48,807 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f8e8d7cf2c5e169edcb3b943f53497bc in 1688ms, sequenceid=5, compaction requested=false 2023-03-19 14:54:48,807 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:48,807 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:48,807 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:54:48,808 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:54:48,807 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:54:48,808 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:48,808 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:54:48,808 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:54:48,808 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,808 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-19 14:54:48,808 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-19 14:54:48,809 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,809 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:48,809 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:48,809 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:48,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-19 14:54:48,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3df649c4[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:48,810 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-19 14:54:48,810 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:48,811 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:48,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:48,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:48,811 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-19 14:54:48,811 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-19 14:54:48,811 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:48,811 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,811 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:48,811 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,811 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-19 14:54:48,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:48,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:48,811 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:48,811 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-19 14:54:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:48,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-19 14:54:48,813 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-19 14:54:48,813 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:48,813 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:48,813 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-19 14:54:48,813 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:48,814 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:48,814 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:48,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:48,814 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:48,814 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,815 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,816 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,816 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:48,816 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:48,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:48,816 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:48,816 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:48,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-19 14:54:48,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:48,816 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:48,816 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,816 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:48,816 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:48,816 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:48,816 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:48,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:48,817 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:48,917 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:48,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:48,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:48,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:48,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:48,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:48,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:48,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-19 14:54:48,932 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-19 14:54:48,932 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:48,932 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-19 14:54:48,932 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-19 14:54:48,932 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:48,932 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:48,933 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:48,933 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:48,933 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:48,933 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:48,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:48,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:48,934 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-19 14:54:48,934 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-19 14:54:48,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-19 14:54:48,934 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-19 14:54:48,934 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:48,934 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-19 14:54:48,935 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:48,935 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. started... 2023-03-19 14:54:48,935 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing affcc240214c2740e267f2d65797302f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-19 14:54:48,938 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:48,938 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. started... 2023-03-19 14:54:48,939 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9aa1fc0f1990ce625d14a4ce4d80764b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-19 14:54:48,939 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:54:48,939 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:48,939 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:48,939 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. started... 2023-03-19 14:54:48,939 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f8e8d7cf2c5e169edcb3b943f53497bc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-19 14:54:48,966 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031917b06df6292c4a93bc08efe28855f932 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031917b06df6292c4a93bc08efe28855f932 2023-03-19 14:54:49,368 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031920e6e46833924d0681cd5112740fe3a9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031920e6e46833924d0681cd5112740fe3a9 2023-03-19 14:54:49,368 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319af3b547e7c924811b007c5d7ad826535 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319af3b547e7c924811b007c5d7ad826535 2023-03-19 14:54:49,371 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/a498a7af9de5499eb5506fb088e5ce4b 2023-03-19 14:54:49,776 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/777791cd950945198d124edb3c132e17 2023-03-19 14:54:49,776 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/9586c74f287d4c8ab2dd569cecbaff4a 2023-03-19 14:54:49,788 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303193fad9b1403f042bdaab1378904f92ea2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303193fad9b1403f042bdaab1378904f92ea2 2023-03-19 14:54:50,194 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/668221e186c0471ab0362e491d94547e 2023-03-19 14:54:50,199 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/a498a7af9de5499eb5506fb088e5ce4b as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/a498a7af9de5499eb5506fb088e5ce4b 2023-03-19 14:54:50,201 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303191ca78181124f45c7b982628690f8e9eb to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303191ca78181124f45c7b982628690f8e9eb 2023-03-19 14:54:50,201 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031945e32c76090b4b809099d4656519018b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031945e32c76090b4b809099d4656519018b 2023-03-19 14:54:50,205 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/a498a7af9de5499eb5506fb088e5ce4b, entries=4, sequenceid=9, filesize=5.4 K 2023-03-19 14:54:50,206 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/668221e186c0471ab0362e491d94547e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/668221e186c0471ab0362e491d94547e 2023-03-19 14:54:50,206 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:54:50,207 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/c6e97c21949b4614ab1977b58cde91a6 2023-03-19 14:54:50,210 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/668221e186c0471ab0362e491d94547e, entries=2, sequenceid=9, filesize=5.1 K 2023-03-19 14:54:50,211 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9aa1fc0f1990ce625d14a4ce4d80764b in 1272ms, sequenceid=9, compaction requested=false 2023-03-19 14:54:50,211 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:54:50,211 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:50,211 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:54:50,211 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/777791cd950945198d124edb3c132e17 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/777791cd950945198d124edb3c132e17 2023-03-19 14:54:50,215 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/777791cd950945198d124edb3c132e17, entries=4, sequenceid=9, filesize=5.4 K 2023-03-19 14:54:50,215 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/c6e97c21949b4614ab1977b58cde91a6 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/c6e97c21949b4614ab1977b58cde91a6 2023-03-19 14:54:50,221 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/c6e97c21949b4614ab1977b58cde91a6, entries=2, sequenceid=9, filesize=5.1 K 2023-03-19 14:54:50,222 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for affcc240214c2740e267f2d65797302f in 1287ms, sequenceid=9, compaction requested=false 2023-03-19 14:54:50,222 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:54:50,222 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:50,222 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:54:50,608 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/f9050243921745d7a421f54a78279f75 2023-03-19 14:54:50,618 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/9586c74f287d4c8ab2dd569cecbaff4a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9586c74f287d4c8ab2dd569cecbaff4a 2023-03-19 14:54:50,625 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9586c74f287d4c8ab2dd569cecbaff4a, entries=4, sequenceid=9, filesize=5.4 K 2023-03-19 14:54:50,626 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/f9050243921745d7a421f54a78279f75 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/f9050243921745d7a421f54a78279f75 2023-03-19 14:54:50,631 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/f9050243921745d7a421f54a78279f75, entries=2, sequenceid=9, filesize=5.1 K 2023-03-19 14:54:50,632 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f8e8d7cf2c5e169edcb3b943f53497bc in 1693ms, sequenceid=9, compaction requested=false 2023-03-19 14:54:50,632 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:54:50,632 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:50,632 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:54:50,632 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:54:50,632 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,633 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-19 14:54:50,633 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-19 14:54:50,634 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,634 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:50,635 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:50,635 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:50,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:50,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-19 14:54:50,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53b045fd[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:50,636 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-19 14:54:50,636 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:50,637 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:50,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:50,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:50,637 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-19 14:54:50,637 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-19 14:54:50,637 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:50,637 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,638 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:50,638 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-19 14:54:50,638 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:50,639 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:50,639 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-19 14:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:50,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-19 14:54:50,641 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-19 14:54:50,641 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:50,641 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:50,641 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-19 14:54:50,641 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:50,650 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:50,650 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:50,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:50,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:50,651 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:50,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:50,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:50,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:50,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:50,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:50,653 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:50,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:50,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:50,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:50,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:50,655 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:50,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:50,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,659 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,659 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:50,659 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:50,659 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:50,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:50,659 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:50,659 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,659 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:50,659 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:50,659 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:50,659 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:50,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-19 14:54:50,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:50,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-19 14:54:50,660 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:50,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:50,660 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:50,760 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:50,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:50,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:50,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:50,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:50,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:50,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:50,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-19 14:54:50,769 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-19 14:54:50,769 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:50,769 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-19 14:54:50,769 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-19 14:54:50,769 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:50,769 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:50,770 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:50,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:50,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:50,770 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,770 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:50,770 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:50,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:50,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:50,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:50,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:50,771 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-19 14:54:50,771 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-19 14:54:50,771 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-19 14:54:50,771 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-19 14:54:50,772 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:50,772 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-19 14:54:50,772 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:50,772 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. started... 2023-03-19 14:54:50,772 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:50,772 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. started... 2023-03-19 14:54:50,772 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing affcc240214c2740e267f2d65797302f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-19 14:54:50,772 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9aa1fc0f1990ce625d14a4ce4d80764b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-19 14:54:50,774 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:54:50,774 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:50,774 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:50,774 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. started... 2023-03-19 14:54:50,774 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f8e8d7cf2c5e169edcb3b943f53497bc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-19 14:54:51,257 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031976cbb33d2823491d9d16b42fd681d5c5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031976cbb33d2823491d9d16b42fd681d5c5 2023-03-19 14:54:51,260 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319979d3c583b1c44488ab75a41f6911c9e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319979d3c583b1c44488ab75a41f6911c9e 2023-03-19 14:54:51,264 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319ada91e6b0e594ddf99788c0f053b6833 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319ada91e6b0e594ddf99788c0f053b6833 2023-03-19 14:54:51,272 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/71050ba6c89a4646b023b0f3e9b57686 2023-03-19 14:54:51,272 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/92eead09b38b4914801146ebd23ef20e 2023-03-19 14:54:51,285 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031901aaa77200744fe1955e5325786c098c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031901aaa77200744fe1955e5325786c098c 2023-03-19 14:54:51,286 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319fabff725451b4dd6ad9e42f6b712c913 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230319fabff725451b4dd6ad9e42f6b712c913 2023-03-19 14:54:51,673 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/22e271661cc847ccad251f5692d9f4cd 2023-03-19 14:54:51,690 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/f1eb51a16aea4f0da9b994008b59c96d 2023-03-19 14:54:51,691 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/d9c52dbb54df402e84d848dbe0313e1d 2023-03-19 14:54:51,692 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031946253ae3b4ba45f19f937c3b397cc1c8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031946253ae3b4ba45f19f937c3b397cc1c8 2023-03-19 14:54:51,695 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/71050ba6c89a4646b023b0f3e9b57686 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/71050ba6c89a4646b023b0f3e9b57686 2023-03-19 14:54:51,695 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/92eead09b38b4914801146ebd23ef20e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/92eead09b38b4914801146ebd23ef20e 2023-03-19 14:54:51,699 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/92eead09b38b4914801146ebd23ef20e, entries=4, sequenceid=13, filesize=5.4 K 2023-03-19 14:54:51,699 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/71050ba6c89a4646b023b0f3e9b57686, entries=4, sequenceid=13, filesize=5.4 K 2023-03-19 14:54:51,700 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/f1eb51a16aea4f0da9b994008b59c96d as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/f1eb51a16aea4f0da9b994008b59c96d 2023-03-19 14:54:51,700 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/d9c52dbb54df402e84d848dbe0313e1d as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/d9c52dbb54df402e84d848dbe0313e1d 2023-03-19 14:54:51,705 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/f1eb51a16aea4f0da9b994008b59c96d, entries=2, sequenceid=13, filesize=5.1 K 2023-03-19 14:54:51,705 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/d9c52dbb54df402e84d848dbe0313e1d, entries=2, sequenceid=13, filesize=5.1 K 2023-03-19 14:54:51,705 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for affcc240214c2740e267f2d65797302f in 933ms, sequenceid=13, compaction requested=true 2023-03-19 14:54:51,705 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9aa1fc0f1990ce625d14a4ce4d80764b in 933ms, sequenceid=13, compaction requested=true 2023-03-19 14:54:51,706 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:54:51,706 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:54:51,706 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:51,706 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:51,706 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:54:51,706 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:54:52,099 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/2452702cd07d48e5b34a29b501705fbd 2023-03-19 14:54:52,104 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/22e271661cc847ccad251f5692d9f4cd as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/22e271661cc847ccad251f5692d9f4cd 2023-03-19 14:54:52,107 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/22e271661cc847ccad251f5692d9f4cd, entries=4, sequenceid=13, filesize=5.4 K 2023-03-19 14:54:52,108 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/2452702cd07d48e5b34a29b501705fbd as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2452702cd07d48e5b34a29b501705fbd 2023-03-19 14:54:52,112 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2452702cd07d48e5b34a29b501705fbd, entries=2, sequenceid=13, filesize=5.1 K 2023-03-19 14:54:52,113 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f8e8d7cf2c5e169edcb3b943f53497bc in 1339ms, sequenceid=13, compaction requested=true 2023-03-19 14:54:52,113 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:54:52,113 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:52,113 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:54:52,113 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:54:52,113 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,113 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-19 14:54:52,113 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-19 14:54:52,114 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,114 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:52,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:52,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:52,114 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:52,114 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:52,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-19 14:54:52,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e4e4aa1[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:52,116 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-19 14:54:52,116 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:52,116 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:52,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:52,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:52,117 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-19 14:54:52,117 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,117 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:52,117 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-19 14:54:52,117 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:52,119 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-19 14:54:52,119 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,119 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:52,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,119 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-19 14:54:52,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:52,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:52,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:52,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:52,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:52,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:52,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:52,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:52,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-19 14:54:52,121 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-19 14:54:52,121 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:52,121 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:52,121 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-19 14:54:52,121 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:52,122 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:52,122 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:52,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:52,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:52,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:52,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:52,122 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:52,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:52,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:52,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:52,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:52,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:52,123 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:52,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:52,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:52,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,124 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:52,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:52,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,125 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,125 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:52,125 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:52,125 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:52,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:52,125 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:52,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-19 14:54:52,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:52,125 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:52,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:52,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-19 14:54:52,126 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,126 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:52,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:52,126 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:52,126 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:52,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:52,126 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:52,126 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:52,226 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:52,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:52,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:52,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:52,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:54:52,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:52,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:52,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-19 14:54:52,234 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-19 14:54:52,234 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:52,234 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-19 14:54:52,234 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-19 14:54:52,235 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:52,235 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:52,235 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,235 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:52,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:52,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:52,236 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:52,236 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:52,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:52,236 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-19 14:54:52,240 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-19 14:54:52,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-19 14:54:52,241 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-19 14:54:52,241 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:52,241 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-19 14:54:52,241 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:52,241 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. started... 2023-03-19 14:54:52,241 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing affcc240214c2740e267f2d65797302f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-19 14:54:52,242 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:52,242 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. started... 2023-03-19 14:54:52,243 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9aa1fc0f1990ce625d14a4ce4d80764b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-19 14:54:52,243 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:54:52,243 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:52,243 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:52,244 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. started... 2023-03-19 14:54:52,244 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f8e8d7cf2c5e169edcb3b943f53497bc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-19 14:54:52,280 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031977e3d605883841a5b00c5f55ba694f64 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031977e3d605883841a5b00c5f55ba694f64 2023-03-19 14:54:52,283 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319c4f62dd3a5624bd391d53da21e831dd0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319c4f62dd3a5624bd391d53da21e831dd0 2023-03-19 14:54:52,293 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319441f0e367e9d4ebc84549c754b858e07 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319441f0e367e9d4ebc84549c754b858e07 2023-03-19 14:54:52,308 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/68dadd12b3e742a187daf4580db38d31 2023-03-19 14:54:52,696 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/64fb2a9331de4b59a3d3baba4334c565 2023-03-19 14:54:52,704 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/6ef705ae3af44268957e31b013687a4a 2023-03-19 14:54:52,723 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031932fd42a9f7e744b19e7e25a7d3ba3e2b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031932fd42a9f7e744b19e7e25a7d3ba3e2b 2023-03-19 14:54:53,126 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031991007cc831b9498c96faf4094d7906b0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031991007cc831b9498c96faf4094d7906b0 2023-03-19 14:54:53,128 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/9ab446dfd8214726af29869a4bc019f0 2023-03-19 14:54:53,128 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303192b0c4b9bf9944dcf9fe2c4c119ef6a88 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303192b0c4b9bf9944dcf9fe2c4c119ef6a88 2023-03-19 14:54:53,133 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/68dadd12b3e742a187daf4580db38d31 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/68dadd12b3e742a187daf4580db38d31 2023-03-19 14:54:53,134 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/eec30539054d4e3cae38aa42c55dc97e 2023-03-19 14:54:53,137 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/68dadd12b3e742a187daf4580db38d31, entries=4, sequenceid=17, filesize=5.4 K 2023-03-19 14:54:53,138 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/6ef705ae3af44268957e31b013687a4a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/6ef705ae3af44268957e31b013687a4a 2023-03-19 14:54:53,138 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/9ab446dfd8214726af29869a4bc019f0 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/9ab446dfd8214726af29869a4bc019f0 2023-03-19 14:54:53,142 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/6ef705ae3af44268957e31b013687a4a, entries=4, sequenceid=17, filesize=5.4 K 2023-03-19 14:54:53,143 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/9ab446dfd8214726af29869a4bc019f0, entries=2, sequenceid=17, filesize=5.1 K 2023-03-19 14:54:53,143 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/eec30539054d4e3cae38aa42c55dc97e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/eec30539054d4e3cae38aa42c55dc97e 2023-03-19 14:54:53,145 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f8e8d7cf2c5e169edcb3b943f53497bc in 901ms, sequenceid=17, compaction requested=true 2023-03-19 14:54:53,145 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:54:53,145 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:53,145 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:54:53,155 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/eec30539054d4e3cae38aa42c55dc97e, entries=2, sequenceid=17, filesize=5.1 K 2023-03-19 14:54:53,155 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9aa1fc0f1990ce625d14a4ce4d80764b in 912ms, sequenceid=17, compaction requested=true 2023-03-19 14:54:53,156 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:54:53,156 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:53,156 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:54:53,463 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-19 14:54:53,533 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/79c100f393d54da7814436e728b5ff49 2023-03-19 14:54:53,544 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/64fb2a9331de4b59a3d3baba4334c565 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/64fb2a9331de4b59a3d3baba4334c565 2023-03-19 14:54:53,549 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/64fb2a9331de4b59a3d3baba4334c565, entries=4, sequenceid=17, filesize=5.4 K 2023-03-19 14:54:53,550 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/79c100f393d54da7814436e728b5ff49 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/79c100f393d54da7814436e728b5ff49 2023-03-19 14:54:53,554 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/79c100f393d54da7814436e728b5ff49, entries=2, sequenceid=17, filesize=5.1 K 2023-03-19 14:54:53,555 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for affcc240214c2740e267f2d65797302f in 1314ms, sequenceid=17, compaction requested=true 2023-03-19 14:54:53,555 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:54:53,555 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:53,555 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:54:53,555 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:54:53,555 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,555 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-19 14:54:53,555 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-19 14:54:53,556 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,556 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:53,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:53,557 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:53,557 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:53,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-19 14:54:53,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48709a1b[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:53,558 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-19 14:54:53,558 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:53,558 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:53,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:53,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:53,558 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-19 14:54:53,559 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-19 14:54:53,559 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,559 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:53,559 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:53,559 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-19 14:54:53,559 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:53,559 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,559 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-19 14:54:53,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:53,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:53,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:53,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:53,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:53,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:53,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:53,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:53,561 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-19 14:54:53,561 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:53,561 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:53,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-19 14:54:53,561 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-19 14:54:53,562 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:53,562 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:53,562 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:53,562 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:53,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:53,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:53,563 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:53,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:53,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:53,563 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:53,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:53,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:53,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:53,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-19 14:54:53,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:53,565 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:53,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:53,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:53,565 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:53,665 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:53,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:53,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-19 14:54:53,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1679237693681 (current time:1679237693681). 2023-03-19 14:54:53,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-19 14:54:53,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] zookeeper.ReadOnlyZKClient(139): Connect 0x101541cc to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:54:53,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64271fa6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:54:53,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:54:53,693 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50284, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:54:53,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x101541cc to 127.0.0.1:56323 2023-03-19 14:54:53,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:54:53,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-19 14:54:53,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-19 14:54:53,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-19 14:54:53,702 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-19 14:54:53,703 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1679238293703 2023-03-19 14:54:53,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-19 14:54:53,703 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1679237693667 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-19 14:54:53,704 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-19 14:54:53,705 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-19 14:54:53,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-03-19 14:54:53,706 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-19 14:54:53,707 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1679238293707 2023-03-19 14:54:53,709 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:53,709 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-19 14:54:53,809 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:54:53,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:54:53,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-19 14:54:53,818 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-19 14:54:54,018 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:54:54,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:54:54,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-19 14:54:54,021 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-19 14:54:54,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1679237693667 2023-03-19 14:54:54,114 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1679237693667' 2023-03-19 14:54:54,114 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-19 14:54:54,114 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1679237693667' starting 'acquire' 2023-03-19 14:54:54,114 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1679237693667', kicking off acquire phase on members. 2023-03-19 14:54:54,115 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1679237693667 2023-03-19 14:54:54,115 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1679237693667 2023-03-19 14:54:54,116 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-19 14:54:54,116 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-19 14:54:54,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-19 14:54:54,116 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,116 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:54,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1679237693667 2023-03-19 14:54:54,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1679237693667 2023-03-19 14:54:54,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-19 14:54:54,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1679237693667 2023-03-19 14:54:54,116 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1679237693667 from table testCompactionWithHFileLink type FLUSH 2023-03-19 14:54:54,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1679237693667 2023-03-19 14:54:54,118 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1679237693667' with timeout 300000ms 2023-03-19 14:54:54,118 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-19 14:54:54,118 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1679237693667' starting 'acquire' stage 2023-03-19 14:54:54,119 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1679237693667' locally acquired 2023-03-19 14:54:54,119 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (snaptb-1679237693667) in zk 2023-03-19 14:54:54,119 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1679237693667 2023-03-19 14:54:54,119 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-19 14:54:54,120 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1679237693667 2023-03-19 14:54:54,120 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1679237693667' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679237693667 2023-03-19 14:54:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:54,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'snaptb-1679237693667' on coordinator 2023-03-19 14:54:54,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47c742b8[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:54,121 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1679237693667' starting 'in-barrier' execution. 2023-03-19 14:54:54,121 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1679237693667 2023-03-19 14:54:54,121 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679237693667 2023-03-19 14:54:54,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1679237693667 2023-03-19 14:54:54,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1679237693667 2023-03-19 14:54:54,121 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1679237693667' received 'reached' from coordinator. 2023-03-19 14:54:54,121 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,121 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:54,122 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:54,122 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:54,122 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:54,122 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-19 14:54:54,123 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-19 14:54:54,123 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. started... 2023-03-19 14:54:54,123 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. started... 2023-03-19 14:54:54,123 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. started... 2023-03-19 14:54:54,123 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:54:54,123 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:54:54,123 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:54:54,124 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.' region-info for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,124 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.' region-info for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,124 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.' region-info for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,128 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-19 14:54:54,128 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-19 14:54:54,128 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-19 14:54:54,130 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/cc44908f6c5e427a90a6ca32334cf79e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/a498a7af9de5499eb5506fb088e5ce4b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/92eead09b38b4914801146ebd23ef20e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/6ef705ae3af44268957e31b013687a4a] hfiles 2023-03-19 14:54:54,130 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/b8be95693f2a440380270ed0b7987057, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/777791cd950945198d124edb3c132e17, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/71050ba6c89a4646b023b0f3e9b57686, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/64fb2a9331de4b59a3d3baba4334c565] hfiles 2023-03-19 14:54:54,130 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/3135a14f577e414b895c137eda08f073, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9586c74f287d4c8ab2dd569cecbaff4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/22e271661cc847ccad251f5692d9f4cd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/68dadd12b3e742a187daf4580db38d31] hfiles 2023-03-19 14:54:54,131 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/b8be95693f2a440380270ed0b7987057 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,131 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/cc44908f6c5e427a90a6ca32334cf79e for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,131 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/3135a14f577e414b895c137eda08f073 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/a498a7af9de5499eb5506fb088e5ce4b for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9586c74f287d4c8ab2dd569cecbaff4a for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/777791cd950945198d124edb3c132e17 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/22e271661cc847ccad251f5692d9f4cd for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/68dadd12b3e742a187daf4580db38d31 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/92eead09b38b4914801146ebd23ef20e for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/71050ba6c89a4646b023b0f3e9b57686 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2ef2f161f72b4885be16d467c2d07fee, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/f9050243921745d7a421f54a78279f75, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2452702cd07d48e5b34a29b501705fbd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/9ab446dfd8214726af29869a4bc019f0] hfiles 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2ef2f161f72b4885be16d467c2d07fee for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/6ef705ae3af44268957e31b013687a4a for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/f9050243921745d7a421f54a78279f75 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,134 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/64fb2a9331de4b59a3d3baba4334c565 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2452702cd07d48e5b34a29b501705fbd for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/fc2b5d5467204a3083e136b8718bf3e2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/c6e97c21949b4614ab1977b58cde91a6, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/d9c52dbb54df402e84d848dbe0313e1d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/79c100f393d54da7814436e728b5ff49] hfiles 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/fc2b5d5467204a3083e136b8718bf3e2 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/71b438b29ca74f3faa56c09a9678e0d7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/668221e186c0471ab0362e491d94547e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/f1eb51a16aea4f0da9b994008b59c96d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/eec30539054d4e3cae38aa42c55dc97e] hfiles 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/c6e97c21949b4614ab1977b58cde91a6 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/9ab446dfd8214726af29869a4bc019f0 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/d9c52dbb54df402e84d848dbe0313e1d for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/71b438b29ca74f3faa56c09a9678e0d7 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/79c100f393d54da7814436e728b5ff49 for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/668221e186c0471ab0362e491d94547e for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/f1eb51a16aea4f0da9b994008b59c96d for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/eec30539054d4e3cae38aa42c55dc97e for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,321 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:54:54,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:54:54,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-19 14:54:54,323 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-19 14:54:54,545 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. completed. 2023-03-19 14:54:54,545 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:54,545 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. completed. 2023-03-19 14:54:54,545 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:54,546 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-19 14:54:54,546 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-19 14:54:54,548 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. completed. 2023-03-19 14:54:54,548 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:54,549 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-19 14:54:54,549 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-19 14:54:54,549 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,549 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1679237693667' locally completed 2023-03-19 14:54:54,549 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1679237693667' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:54,552 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,552 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1679237693667' has notified controller of completion 2023-03-19 14:54:54,552 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-19 14:54:54,553 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1679237693667' completed. 2023-03-19 14:54:54,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:54,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:54,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679237693667 2023-03-19 14:54:54,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:54,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679237693667 2023-03-19 14:54:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1679237693667' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:54,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'snaptb-1679237693667', counting down latch. Waiting for 0 more 2023-03-19 14:54:54,561 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1679237693667' execution completed 2023-03-19 14:54:54,561 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:54,561 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:54,561 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1679237693667 2023-03-19 14:54:54,561 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1679237693667including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-19 14:54:54,567 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679237693667 2023-03-19 14:54:54,567 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-19 14:54:54,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1679237693667 2023-03-19 14:54:54,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1679237693667 2023-03-19 14:54:54,567 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679237693667 2023-03-19 14:54:54,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1679237693667 2023-03-19 14:54:54,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:54,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-19 14:54:54,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-19 14:54:54,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-19 14:54:54,569 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:54,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1679237693667 2023-03-19 14:54:54,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679237693667 2023-03-19 14:54:54,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:54,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679237693667 2023-03-19 14:54:54,571 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:54,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1679237693667 2023-03-19 14:54:54,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,576 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-19 14:54:54,576 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,576 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:54,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1679237693667 2023-03-19 14:54:54,576 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679237693667 2023-03-19 14:54:54,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-19 14:54:54,576 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-19 14:54:54,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-19 14:54:54,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-19 14:54:54,576 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1679237693667 2023-03-19 14:54:54,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1679237693667 2023-03-19 14:54:54,577 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679237693667/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:54,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1679237693667 because node does not exist (not an error) 2023-03-19 14:54:54,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-19 14:54:54,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-19 14:54:54,577 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679237693667 2023-03-19 14:54:54,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-19 14:54:54,577 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1679237693667 2023-03-19 14:54:54,577 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1679237693667 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031917b06df6292c4a93bc08efe28855f932, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319a445dc1c66df4f1b8f2f2e675e7a98ac, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319ada91e6b0e594ddf99788c0f053b6833, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319c4f62dd3a5624bd391d53da21e831dd0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031920e6e46833924d0681cd5112740fe3a9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230319614dfba9fb484c17b78e7e0af5487225, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031976cbb33d2823491d9d16b42fd681d5c5, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031977e3d605883841a5b00c5f55ba694f64, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319313c4a0385ba497c82db271515476776, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319441f0e367e9d4ebc84549c754b858e07, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319979d3c583b1c44488ab75a41f6911c9e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319af3b547e7c924811b007c5d7ad826535] mob files 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031917b06df6292c4a93bc08efe28855f932 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319a445dc1c66df4f1b8f2f2e675e7a98ac 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319ada91e6b0e594ddf99788c0f053b6833 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319c4f62dd3a5624bd391d53da21e831dd0 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031920e6e46833924d0681cd5112740fe3a9 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230319614dfba9fb484c17b78e7e0af5487225 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031976cbb33d2823491d9d16b42fd681d5c5 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031977e3d605883841a5b00c5f55ba694f64 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319313c4a0385ba497c82db271515476776 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319441f0e367e9d4ebc84549c754b858e07 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319979d3c583b1c44488ab75a41f6911c9e 2023-03-19 14:54:54,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319af3b547e7c924811b007c5d7ad826535 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031901aaa77200744fe1955e5325786c098c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303192b0c4b9bf9944dcf9fe2c4c119ef6a88, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303193fad9b1403f042bdaab1378904f92ea2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230319437c17dffd754379aef4dc8fb0a91269, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303191ca78181124f45c7b982628690f8e9eb, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031968235407d2b24f0d994b5825317eb9d9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031991007cc831b9498c96faf4094d7906b0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230319fabff725451b4dd6ad9e42f6b712c913, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031932fd42a9f7e744b19e7e25a7d3ba3e2b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031945e32c76090b4b809099d4656519018b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031946253ae3b4ba45f19f937c3b397cc1c8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303198a8ee595b9454d75a72ae4dc55785002] mob files 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031901aaa77200744fe1955e5325786c098c 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303192b0c4b9bf9944dcf9fe2c4c119ef6a88 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303193fad9b1403f042bdaab1378904f92ea2 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230319437c17dffd754379aef4dc8fb0a91269 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303191ca78181124f45c7b982628690f8e9eb 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031968235407d2b24f0d994b5825317eb9d9 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031991007cc831b9498c96faf4094d7906b0 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230319fabff725451b4dd6ad9e42f6b712c913 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031932fd42a9f7e744b19e7e25a7d3ba3e2b 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031945e32c76090b4b809099d4656519018b 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031946253ae3b4ba45f19f937c3b397cc1c8 2023-03-19 14:54:54,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303198a8ee595b9454d75a72ae4dc55785002 2023-03-19 14:54:54,823 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:54:54,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:54:54,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-19 14:54:54,826 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-19 14:54:54,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1679237693667 2023-03-19 14:54:54,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/.tmp/snaptb-1679237693667 2023-03-19 14:54:55,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/.tmp/snaptb-1679237693667 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/snaptb-1679237693667 2023-03-19 14:54:55,826 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:54:55,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:54:55,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-19 14:54:55,828 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-03-19 14:54:56,259 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1679237693667 of table testCompactionWithHFileLink completed 2023-03-19 14:54:56,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/.tmp/snaptb-1679237693667 2023-03-19 14:54:56,261 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/.tmp/snaptb-1679237693667 2023-03-19 14:54:56,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1679237693667 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1679237693703Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1679237694986 (+1283 ms)Consolidate snapshot: snaptb-1679237693667 at 1679237694986Loading Region manifests for snaptb-1679237693667 at 1679237694986Writing data manifest for snaptb-1679237693667 at 1679237695000 (+14 ms)Verifying snapshot: snaptb-1679237693667 at 1679237695410 (+410 ms)Snapshot snaptb-1679237693667 of table testCompactionWithHFileLink completed at 1679237696259 (+849 ms) 2023-03-19 14:54:56,264 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-19 14:54:56,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.5590 sec 2023-03-19 14:54:57,828 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:54:57,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:54:57,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-19 14:54:57,953 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:54:57,953 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-19 14:54:57,953 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06ffdd9e to 127.0.0.1:56323 2023-03-19 14:54:57,953 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:54:57,954 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ea94a71 to 127.0.0.1:56323 2023-03-19 14:54:57,954 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:54:57,954 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:54:57,954 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1068f199 to 127.0.0.1:56323 2023-03-19 14:54:57,954 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:54:57,954 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:54:57,954 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48028d80 to 127.0.0.1:56323 2023-03-19 14:54:57,954 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:54:57,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:54:57,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-19 14:54:57,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-19 14:54:57,989 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-19 14:54:57,989 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:57,989 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-19 14:54:57,989 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-19 14:54:57,989 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:57,990 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:57,990 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:57,990 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:57,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:57,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:57,991 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:57,991 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:54:57,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:57,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:57,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:54:57,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:57,991 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-19 14:54:57,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-19 14:54:57,992 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-19 14:54:57,992 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:54:57,992 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-19 14:54:57,992 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:57,992 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. started... 2023-03-19 14:54:57,992 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:57,992 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. started... 2023-03-19 14:54:57,992 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:54:57,992 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 9aa1fc0f1990ce625d14a4ce4d80764b 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-19 14:54:57,992 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:54:57,992 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing affcc240214c2740e267f2d65797302f 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-19 14:54:57,992 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:57,992 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. started... 2023-03-19 14:54:57,992 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f8e8d7cf2c5e169edcb3b943f53497bc 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-19 14:54:58,821 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/927de26fd8704c29adaf72406386b0ea 2023-03-19 14:54:58,825 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/dd6ffd4bb36f410f9664670c5bccfefb 2023-03-19 14:54:58,825 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/5a773436d30343e7b81db055bd482ea3 2023-03-19 14:54:58,831 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 927de26fd8704c29adaf72406386b0ea 2023-03-19 14:54:58,831 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a773436d30343e7b81db055bd482ea3 2023-03-19 14:54:58,832 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd6ffd4bb36f410f9664670c5bccfefb 2023-03-19 14:54:58,966 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:54:59,656 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/47d67c94e2da4aae97e7d59752f50f56 2023-03-19 14:54:59,656 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/38fd7872eae743b0baf207dea9b4295b 2023-03-19 14:54:59,656 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/2e826f5d9e3d4968bda0e12666ee0999 2023-03-19 14:54:59,664 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38fd7872eae743b0baf207dea9b4295b 2023-03-19 14:54:59,664 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47d67c94e2da4aae97e7d59752f50f56 2023-03-19 14:54:59,664 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e826f5d9e3d4968bda0e12666ee0999 2023-03-19 14:54:59,665 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/5a773436d30343e7b81db055bd482ea3 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/5a773436d30343e7b81db055bd482ea3 2023-03-19 14:54:59,665 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/dd6ffd4bb36f410f9664670c5bccfefb as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/dd6ffd4bb36f410f9664670c5bccfefb 2023-03-19 14:54:59,665 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/927de26fd8704c29adaf72406386b0ea as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/927de26fd8704c29adaf72406386b0ea 2023-03-19 14:54:59,669 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 927de26fd8704c29adaf72406386b0ea 2023-03-19 14:54:59,669 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dd6ffd4bb36f410f9664670c5bccfefb 2023-03-19 14:54:59,669 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/927de26fd8704c29adaf72406386b0ea, entries=3, sequenceid=24, filesize=5.0 K 2023-03-19 14:54:59,669 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/dd6ffd4bb36f410f9664670c5bccfefb, entries=3, sequenceid=24, filesize=5.0 K 2023-03-19 14:54:59,669 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a773436d30343e7b81db055bd482ea3 2023-03-19 14:54:59,670 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/5a773436d30343e7b81db055bd482ea3, entries=3, sequenceid=24, filesize=5.0 K 2023-03-19 14:54:59,670 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/2e826f5d9e3d4968bda0e12666ee0999 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/2e826f5d9e3d4968bda0e12666ee0999 2023-03-19 14:54:59,670 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/38fd7872eae743b0baf207dea9b4295b as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/38fd7872eae743b0baf207dea9b4295b 2023-03-19 14:54:59,670 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/47d67c94e2da4aae97e7d59752f50f56 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/47d67c94e2da4aae97e7d59752f50f56 2023-03-19 14:54:59,674 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e826f5d9e3d4968bda0e12666ee0999 2023-03-19 14:54:59,674 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47d67c94e2da4aae97e7d59752f50f56 2023-03-19 14:54:59,674 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/2e826f5d9e3d4968bda0e12666ee0999, entries=1, sequenceid=24, filesize=5.0 K 2023-03-19 14:54:59,675 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38fd7872eae743b0baf207dea9b4295b 2023-03-19 14:54:59,675 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/47d67c94e2da4aae97e7d59752f50f56, entries=1, sequenceid=24, filesize=5.0 K 2023-03-19 14:54:59,675 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/38fd7872eae743b0baf207dea9b4295b, entries=1, sequenceid=24, filesize=5.0 K 2023-03-19 14:54:59,675 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for affcc240214c2740e267f2d65797302f in 1683ms, sequenceid=24, compaction requested=true 2023-03-19 14:54:59,675 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9aa1fc0f1990ce625d14a4ce4d80764b in 1683ms, sequenceid=24, compaction requested=true 2023-03-19 14:54:59,675 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f8e8d7cf2c5e169edcb3b943f53497bc in 1683ms, sequenceid=24, compaction requested=true 2023-03-19 14:54:59,675 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:54:59,675 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:54:59,675 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:54:59,675 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:54:59,675 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:54:59,675 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:54:59,675 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:54:59,675 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:59,676 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:54:59,676 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:54:59,676 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,676 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-19 14:54:59,676 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-19 14:54:59,677 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:59,677 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:59,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:59,677 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:59,677 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:54:59,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:59,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:59,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:59,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:59,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-19 14:54:59,679 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-19 14:54:59,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16897810[Count = 0] remaining members to acquire global barrier 2023-03-19 14:54:59,679 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:59,679 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:59,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:59,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:59,679 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-19 14:54:59,679 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,679 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:54:59,679 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-19 14:54:59,680 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:54:59,680 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-19 14:54:59,680 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,680 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:59,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:59,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:59,680 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-19 14:54:59,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:59,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:54:59,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-19 14:54:59,682 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-19 14:54:59,682 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:54:59,682 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:54:59,682 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-19 14:54:59,682 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:54:59,683 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:59,683 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:59,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:59,683 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:54:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:54:59,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:59,683 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:54:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:59,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:59,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:54:59,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:59,684 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:54:59,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-19 14:54:59,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,685 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,685 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:59,685 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:54:59,685 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-19 14:54:59,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:54:59,685 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:54:59,685 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:54:59,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-19 14:54:59,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:54:59,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:54:59,685 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:54:59,685 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:59,686 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-19 14:54:59,686 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-19 14:54:59,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-19 14:54:59,686 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-19 14:54:59,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:54:59,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:54:59,686 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:54:59,786 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:54:59,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:54:59,789 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:54:59,789 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): affcc240214c2740e267f2d65797302f/family1 is initiating major compaction (all files) 2023-03-19 14:54:59,790 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:54:59,790 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:54:59,790 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of affcc240214c2740e267f2d65797302f/family1 in testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:54:59,791 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/b8be95693f2a440380270ed0b7987057, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/777791cd950945198d124edb3c132e17, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/71050ba6c89a4646b023b0f3e9b57686, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/64fb2a9331de4b59a3d3baba4334c565, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/927de26fd8704c29adaf72406386b0ea] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp, totalSize=26.7 K 2023-03-19 14:54:59,792 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting b8be95693f2a440380270ed0b7987057, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687108 2023-03-19 14:54:59,793 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 777791cd950945198d124edb3c132e17, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688922 2023-03-19 14:54:59,794 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 71050ba6c89a4646b023b0f3e9b57686, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:54:59,796 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 64fb2a9331de4b59a3d3baba4334c565, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692229 2023-03-19 14:54:59,797 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 927de26fd8704c29adaf72406386b0ea, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-19 14:54:59,815 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): affcc240214c2740e267f2d65797302f#family1#compaction#108 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:00,225 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303195794bc1aa1f044578d14940b68d7a39e_del 2023-03-19 14:55:00,225 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303195794bc1aa1f044578d14940b68d7a39e_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303195794bc1aa1f044578d14940b68d7a39e_del 2023-03-19 14:55:01,059 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1bedc25df4b4a4bbf74a9d83cb1c5c9 2023-03-19 14:55:01,060 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/f1bedc25df4b4a4bbf74a9d83cb1c5c9 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/f1bedc25df4b4a4bbf74a9d83cb1c5c9 2023-03-19 14:55:01,065 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1bedc25df4b4a4bbf74a9d83cb1c5c9 2023-03-19 14:55:01,066 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in affcc240214c2740e267f2d65797302f/family1 of affcc240214c2740e267f2d65797302f into f1bedc25df4b4a4bbf74a9d83cb1c5c9(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:01,066 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:55:01,067 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:01,067 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): affcc240214c2740e267f2d65797302f/family2 is initiating major compaction (all files) 2023-03-19 14:55:01,067 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:01,067 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:01,067 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of affcc240214c2740e267f2d65797302f/family2 in testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:01,067 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/fc2b5d5467204a3083e136b8718bf3e2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/c6e97c21949b4614ab1977b58cde91a6, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/d9c52dbb54df402e84d848dbe0313e1d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/79c100f393d54da7814436e728b5ff49, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/2e826f5d9e3d4968bda0e12666ee0999] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp, totalSize=25.4 K 2023-03-19 14:55:01,068 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting fc2b5d5467204a3083e136b8718bf3e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687108 2023-03-19 14:55:01,068 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting c6e97c21949b4614ab1977b58cde91a6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688922 2023-03-19 14:55:01,069 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting d9c52dbb54df402e84d848dbe0313e1d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:01,069 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 79c100f393d54da7814436e728b5ff49, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692229 2023-03-19 14:55:01,070 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 2e826f5d9e3d4968bda0e12666ee0999, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-19 14:55:01,082 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): affcc240214c2740e267f2d65797302f#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:01,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/b8be95693f2a440380270ed0b7987057, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/777791cd950945198d124edb3c132e17, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/71050ba6c89a4646b023b0f3e9b57686, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/64fb2a9331de4b59a3d3baba4334c565, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/927de26fd8704c29adaf72406386b0ea] to archive 2023-03-19 14:55:01,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:01,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/b8be95693f2a440380270ed0b7987057 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/b8be95693f2a440380270ed0b7987057 2023-03-19 14:55:01,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/777791cd950945198d124edb3c132e17 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/777791cd950945198d124edb3c132e17 2023-03-19 14:55:01,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/71050ba6c89a4646b023b0f3e9b57686 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/71050ba6c89a4646b023b0f3e9b57686 2023-03-19 14:55:01,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/64fb2a9331de4b59a3d3baba4334c565 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/64fb2a9331de4b59a3d3baba4334c565 2023-03-19 14:55:01,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/927de26fd8704c29adaf72406386b0ea to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/927de26fd8704c29adaf72406386b0ea 2023-03-19 14:55:01,496 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303197934936ba7614f73b51187e269d8c895_del 2023-03-19 14:55:01,496 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303197934936ba7614f73b51187e269d8c895_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303197934936ba7614f73b51187e269d8c895_del 2023-03-19 14:55:02,325 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 150a69359bde4af58bb6876997caf859 2023-03-19 14:55:02,326 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/150a69359bde4af58bb6876997caf859 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/150a69359bde4af58bb6876997caf859 2023-03-19 14:55:02,332 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 150a69359bde4af58bb6876997caf859 2023-03-19 14:55:02,333 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in affcc240214c2740e267f2d65797302f/family2 of affcc240214c2740e267f2d65797302f into 150a69359bde4af58bb6876997caf859(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:02,334 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:55:02,334 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:02,334 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): 9aa1fc0f1990ce625d14a4ce4d80764b/family1 is initiating major compaction (all files) 2023-03-19 14:55:02,334 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:02,334 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:02,334 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of 9aa1fc0f1990ce625d14a4ce4d80764b/family1 in testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:02,335 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/cc44908f6c5e427a90a6ca32334cf79e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/a498a7af9de5499eb5506fb088e5ce4b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/92eead09b38b4914801146ebd23ef20e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/6ef705ae3af44268957e31b013687a4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/dd6ffd4bb36f410f9664670c5bccfefb] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp, totalSize=26.7 K 2023-03-19 14:55:02,335 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting cc44908f6c5e427a90a6ca32334cf79e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687107 2023-03-19 14:55:02,336 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting a498a7af9de5499eb5506fb088e5ce4b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688921 2023-03-19 14:55:02,336 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 92eead09b38b4914801146ebd23ef20e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:02,337 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 6ef705ae3af44268957e31b013687a4a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692229 2023-03-19 14:55:02,337 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting dd6ffd4bb36f410f9664670c5bccfefb, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-19 14:55:02,348 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): 9aa1fc0f1990ce625d14a4ce4d80764b#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:02,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/fc2b5d5467204a3083e136b8718bf3e2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/c6e97c21949b4614ab1977b58cde91a6, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/d9c52dbb54df402e84d848dbe0313e1d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/79c100f393d54da7814436e728b5ff49, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/2e826f5d9e3d4968bda0e12666ee0999] to archive 2023-03-19 14:55:02,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:02,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/fc2b5d5467204a3083e136b8718bf3e2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/fc2b5d5467204a3083e136b8718bf3e2 2023-03-19 14:55:02,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/c6e97c21949b4614ab1977b58cde91a6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/c6e97c21949b4614ab1977b58cde91a6 2023-03-19 14:55:02,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/d9c52dbb54df402e84d848dbe0313e1d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/d9c52dbb54df402e84d848dbe0313e1d 2023-03-19 14:55:02,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/79c100f393d54da7814436e728b5ff49 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/79c100f393d54da7814436e728b5ff49 2023-03-19 14:55:02,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/2e826f5d9e3d4968bda0e12666ee0999 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/2e826f5d9e3d4968bda0e12666ee0999 2023-03-19 14:55:02,757 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303192efa984a363346b590ce9b315ab0e714_del 2023-03-19 14:55:02,758 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303192efa984a363346b590ce9b315ab0e714_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303192efa984a363346b590ce9b315ab0e714_del 2023-03-19 14:55:03,579 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c451d7cab5104a0faedfc98f4be96b12 2023-03-19 14:55:03,580 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/c451d7cab5104a0faedfc98f4be96b12 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c451d7cab5104a0faedfc98f4be96b12 2023-03-19 14:55:03,585 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c451d7cab5104a0faedfc98f4be96b12 2023-03-19 14:55:03,586 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9aa1fc0f1990ce625d14a4ce4d80764b/family1 of 9aa1fc0f1990ce625d14a4ce4d80764b into c451d7cab5104a0faedfc98f4be96b12(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:03,586 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:55:03,586 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:03,586 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): 9aa1fc0f1990ce625d14a4ce4d80764b/family2 is initiating major compaction (all files) 2023-03-19 14:55:03,587 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:03,587 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:03,587 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of 9aa1fc0f1990ce625d14a4ce4d80764b/family2 in testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:03,587 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/71b438b29ca74f3faa56c09a9678e0d7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/668221e186c0471ab0362e491d94547e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/f1eb51a16aea4f0da9b994008b59c96d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/eec30539054d4e3cae38aa42c55dc97e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/47d67c94e2da4aae97e7d59752f50f56] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp, totalSize=25.4 K 2023-03-19 14:55:03,587 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 71b438b29ca74f3faa56c09a9678e0d7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687107 2023-03-19 14:55:03,588 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 668221e186c0471ab0362e491d94547e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688921 2023-03-19 14:55:03,589 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting f1eb51a16aea4f0da9b994008b59c96d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:03,589 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting eec30539054d4e3cae38aa42c55dc97e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692229 2023-03-19 14:55:03,589 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 47d67c94e2da4aae97e7d59752f50f56, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-19 14:55:03,605 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): 9aa1fc0f1990ce625d14a4ce4d80764b#family2#compaction#111 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:03,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/cc44908f6c5e427a90a6ca32334cf79e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/a498a7af9de5499eb5506fb088e5ce4b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/92eead09b38b4914801146ebd23ef20e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/6ef705ae3af44268957e31b013687a4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/dd6ffd4bb36f410f9664670c5bccfefb] to archive 2023-03-19 14:55:03,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:03,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/cc44908f6c5e427a90a6ca32334cf79e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/cc44908f6c5e427a90a6ca32334cf79e 2023-03-19 14:55:03,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/a498a7af9de5499eb5506fb088e5ce4b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/a498a7af9de5499eb5506fb088e5ce4b 2023-03-19 14:55:03,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/92eead09b38b4914801146ebd23ef20e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/92eead09b38b4914801146ebd23ef20e 2023-03-19 14:55:03,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/6ef705ae3af44268957e31b013687a4a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/6ef705ae3af44268957e31b013687a4a 2023-03-19 14:55:03,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/dd6ffd4bb36f410f9664670c5bccfefb to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/dd6ffd4bb36f410f9664670c5bccfefb 2023-03-19 14:55:04,015 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230319094ee14fcb054002999931bb991e31fc_del 2023-03-19 14:55:04,015 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319094ee14fcb054002999931bb991e31fc_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230319094ee14fcb054002999931bb991e31fc_del 2023-03-19 14:55:04,833 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34b8d2ee03d14f78b82ef2fe1328471b 2023-03-19 14:55:04,834 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/34b8d2ee03d14f78b82ef2fe1328471b as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/34b8d2ee03d14f78b82ef2fe1328471b 2023-03-19 14:55:04,838 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34b8d2ee03d14f78b82ef2fe1328471b 2023-03-19 14:55:04,839 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9aa1fc0f1990ce625d14a4ce4d80764b/family2 of 9aa1fc0f1990ce625d14a4ce4d80764b into 34b8d2ee03d14f78b82ef2fe1328471b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:04,839 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:55:04,839 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:04,839 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): f8e8d7cf2c5e169edcb3b943f53497bc/family1 is initiating major compaction (all files) 2023-03-19 14:55:04,839 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:04,840 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:04,840 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of f8e8d7cf2c5e169edcb3b943f53497bc/family1 in testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:04,840 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/3135a14f577e414b895c137eda08f073, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9586c74f287d4c8ab2dd569cecbaff4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/22e271661cc847ccad251f5692d9f4cd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/68dadd12b3e742a187daf4580db38d31, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/5a773436d30343e7b81db055bd482ea3] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp, totalSize=26.7 K 2023-03-19 14:55:04,840 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 3135a14f577e414b895c137eda08f073, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687106 2023-03-19 14:55:04,841 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 9586c74f287d4c8ab2dd569cecbaff4a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688921 2023-03-19 14:55:04,841 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 22e271661cc847ccad251f5692d9f4cd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:04,841 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 68dadd12b3e742a187daf4580db38d31, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692228 2023-03-19 14:55:04,842 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 5a773436d30343e7b81db055bd482ea3, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-19 14:55:04,853 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): f8e8d7cf2c5e169edcb3b943f53497bc#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:04,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/71b438b29ca74f3faa56c09a9678e0d7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/668221e186c0471ab0362e491d94547e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/f1eb51a16aea4f0da9b994008b59c96d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/eec30539054d4e3cae38aa42c55dc97e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/47d67c94e2da4aae97e7d59752f50f56] to archive 2023-03-19 14:55:04,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:04,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/71b438b29ca74f3faa56c09a9678e0d7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/71b438b29ca74f3faa56c09a9678e0d7 2023-03-19 14:55:04,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/668221e186c0471ab0362e491d94547e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/668221e186c0471ab0362e491d94547e 2023-03-19 14:55:04,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/f1eb51a16aea4f0da9b994008b59c96d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/f1eb51a16aea4f0da9b994008b59c96d 2023-03-19 14:55:04,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/eec30539054d4e3cae38aa42c55dc97e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/eec30539054d4e3cae38aa42c55dc97e 2023-03-19 14:55:04,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/47d67c94e2da4aae97e7d59752f50f56 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/47d67c94e2da4aae97e7d59752f50f56 2023-03-19 14:55:05,269 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230319bbdc4c70db1b454cb66e3a53b645f80a_del 2023-03-19 14:55:05,269 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319bbdc4c70db1b454cb66e3a53b645f80a_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319bbdc4c70db1b454cb66e3a53b645f80a_del 2023-03-19 14:55:06,089 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 572c0bf606a2475c9716fa1d6d176e2a 2023-03-19 14:55:06,090 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/572c0bf606a2475c9716fa1d6d176e2a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/572c0bf606a2475c9716fa1d6d176e2a 2023-03-19 14:55:06,095 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 572c0bf606a2475c9716fa1d6d176e2a 2023-03-19 14:55:06,096 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f8e8d7cf2c5e169edcb3b943f53497bc/family1 of f8e8d7cf2c5e169edcb3b943f53497bc into 572c0bf606a2475c9716fa1d6d176e2a(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:06,096 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:55:06,096 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:06,096 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): f8e8d7cf2c5e169edcb3b943f53497bc/family2 is initiating major compaction (all files) 2023-03-19 14:55:06,097 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:06,097 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:06,097 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of f8e8d7cf2c5e169edcb3b943f53497bc/family2 in testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:06,097 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2ef2f161f72b4885be16d467c2d07fee, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/f9050243921745d7a421f54a78279f75, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2452702cd07d48e5b34a29b501705fbd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/9ab446dfd8214726af29869a4bc019f0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/38fd7872eae743b0baf207dea9b4295b] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp, totalSize=25.4 K 2023-03-19 14:55:06,098 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 2ef2f161f72b4885be16d467c2d07fee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687106 2023-03-19 14:55:06,098 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting f9050243921745d7a421f54a78279f75, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688921 2023-03-19 14:55:06,099 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 2452702cd07d48e5b34a29b501705fbd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:06,099 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 9ab446dfd8214726af29869a4bc019f0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692228 2023-03-19 14:55:06,099 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 38fd7872eae743b0baf207dea9b4295b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-19 14:55:06,113 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): f8e8d7cf2c5e169edcb3b943f53497bc#family2#compaction#113 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:06,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/3135a14f577e414b895c137eda08f073, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9586c74f287d4c8ab2dd569cecbaff4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/22e271661cc847ccad251f5692d9f4cd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/68dadd12b3e742a187daf4580db38d31, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/5a773436d30343e7b81db055bd482ea3] to archive 2023-03-19 14:55:06,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:06,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/3135a14f577e414b895c137eda08f073 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/3135a14f577e414b895c137eda08f073 2023-03-19 14:55:06,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9586c74f287d4c8ab2dd569cecbaff4a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9586c74f287d4c8ab2dd569cecbaff4a 2023-03-19 14:55:06,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/22e271661cc847ccad251f5692d9f4cd to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/22e271661cc847ccad251f5692d9f4cd 2023-03-19 14:55:06,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/68dadd12b3e742a187daf4580db38d31 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/68dadd12b3e742a187daf4580db38d31 2023-03-19 14:55:06,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/5a773436d30343e7b81db055bd482ea3 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/5a773436d30343e7b81db055bd482ea3 2023-03-19 14:55:06,521 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230319f1b5815c66074fb99bb394ff2fb0eaf4_del 2023-03-19 14:55:06,521 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319f1b5815c66074fb99bb394ff2fb0eaf4_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230319f1b5815c66074fb99bb394ff2fb0eaf4_del 2023-03-19 14:55:06,943 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73193623aa434c1c91ec3be6457405bd 2023-03-19 14:55:06,945 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/73193623aa434c1c91ec3be6457405bd as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/73193623aa434c1c91ec3be6457405bd 2023-03-19 14:55:06,949 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73193623aa434c1c91ec3be6457405bd 2023-03-19 14:55:06,950 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f8e8d7cf2c5e169edcb3b943f53497bc/family2 of f8e8d7cf2c5e169edcb3b943f53497bc into 73193623aa434c1c91ec3be6457405bd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:06,950 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:55:06,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2ef2f161f72b4885be16d467c2d07fee, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/f9050243921745d7a421f54a78279f75, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2452702cd07d48e5b34a29b501705fbd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/9ab446dfd8214726af29869a4bc019f0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/38fd7872eae743b0baf207dea9b4295b] to archive 2023-03-19 14:55:06,954 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:06,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:06,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2ef2f161f72b4885be16d467c2d07fee to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2ef2f161f72b4885be16d467c2d07fee 2023-03-19 14:55:06,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/f9050243921745d7a421f54a78279f75 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/f9050243921745d7a421f54a78279f75 2023-03-19 14:55:06,959 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:06,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2452702cd07d48e5b34a29b501705fbd to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/2452702cd07d48e5b34a29b501705fbd 2023-03-19 14:55:06,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/9ab446dfd8214726af29869a4bc019f0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/9ab446dfd8214726af29869a4bc019f0 2023-03-19 14:55:06,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/38fd7872eae743b0baf207dea9b4295b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/38fd7872eae743b0baf207dea9b4295b 2023-03-19 14:55:06,965 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:06,967 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:06,973 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-19 14:55:07,007 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-19 14:55:07,011 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230319bbdc4c70db1b454cb66e3a53b645f80a_del 2023-03-19 14:55:07,014 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202303192efa984a363346b590ce9b315ab0e714_del 2023-03-19 14:55:07,017 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303195794bc1aa1f044578d14940b68d7a39e_del 2023-03-19 14:55:07,017 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:07,017 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ReadOnlyZKClient(139): Connect 0x1b003a50 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:55:07,034 DEBUG [Listener at localhost.localdomain/46521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b8b858, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:55:07,034 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:07,035 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:07,035 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:07,507 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031939397150d3f34204a891bb12dbdf5a61 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031939397150d3f34204a891bb12dbdf5a61 2023-03-19 14:55:07,507 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:07,518 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:55:07,521 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:55:07,528 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:55:07,530 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34444, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:55:07,540 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230319/family1/e0df3601890445c1a5a8e435a3580acb first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-19 14:55:07,541 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230319/family1/e0df3601890445c1a5a8e435a3580acb}] 2023-03-19 14:55:07,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230319/family1/e0df3601890445c1a5a8e435a3580acb for inclusion in 9aa1fc0f1990ce625d14a4ce4d80764b/family1 2023-03-19 14:55:07,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-19 14:55:07,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-19 14:55:07,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:55:07,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230319/family1/e0df3601890445c1a5a8e435a3580acb to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__dfmol44mqpvdgb5hbhmr6nr6dog4mah585sg9knpuuf9b6g1o1i83es679sapd7q/family1/e0df3601890445c1a5a8e435a3580acb 2023-03-19 14:55:07,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__dfmol44mqpvdgb5hbhmr6nr6dog4mah585sg9knpuuf9b6g1o1i83es679sapd7q/family1/e0df3601890445c1a5a8e435a3580acb as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c8b4eb5cde9c431c8c6a228432338974_SeqId_29_ 2023-03-19 14:55:07,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__dfmol44mqpvdgb5hbhmr6nr6dog4mah585sg9knpuuf9b6g1o1i83es679sapd7q/family1/e0df3601890445c1a5a8e435a3580acb into 9aa1fc0f1990ce625d14a4ce4d80764b/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c8b4eb5cde9c431c8c6a228432338974_SeqId_29_ - updating store file list. 2023-03-19 14:55:07,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c8b4eb5cde9c431c8c6a228432338974_SeqId_29_ into 9aa1fc0f1990ce625d14a4ce4d80764b/family1 2023-03-19 14:55:07,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__dfmol44mqpvdgb5hbhmr6nr6dog4mah585sg9knpuuf9b6g1o1i83es679sapd7q/family1/e0df3601890445c1a5a8e435a3580acb into 9aa1fc0f1990ce625d14a4ce4d80764b/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c8b4eb5cde9c431c8c6a228432338974_SeqId_29_) 2023-03-19 14:55:07,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__dfmol44mqpvdgb5hbhmr6nr6dog4mah585sg9knpuuf9b6g1o1i83es679sapd7q/family1/e0df3601890445c1a5a8e435a3580acb 2023-03-19 14:55:07,556 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:07,557 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:07,558 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031917b06df6292c4a93bc08efe28855f932 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031917b06df6292c4a93bc08efe28855f932 2023-03-19 14:55:07,559 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319a445dc1c66df4f1b8f2f2e675e7a98ac to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319a445dc1c66df4f1b8f2f2e675e7a98ac 2023-03-19 14:55:07,559 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319ada91e6b0e594ddf99788c0f053b6833 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319ada91e6b0e594ddf99788c0f053b6833 2023-03-19 14:55:07,560 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319c4f62dd3a5624bd391d53da21e831dd0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230319c4f62dd3a5624bd391d53da21e831dd0 2023-03-19 14:55:07,560 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-19 14:55:07,560 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230319' 2023-03-19 14:55:07,560 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:07,903 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031960f5cdd9d6154619be7c20c446ee25b5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031960f5cdd9d6154619be7c20c446ee25b5 2023-03-19 14:55:07,904 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:07,911 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031968745fa08ace4969bdb14aae5fc13f9a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031968745fa08ace4969bdb14aae5fc13f9a 2023-03-19 14:55:07,912 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:07,937 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230319/family1/d2d73d3ef72e4960b179d883d95b89cc first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-19 14:55:07,940 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230319/family1/d2d73d3ef72e4960b179d883d95b89cc}] 2023-03-19 14:55:07,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230319/family1/d2d73d3ef72e4960b179d883d95b89cc for inclusion in f8e8d7cf2c5e169edcb3b943f53497bc/family1 2023-03-19 14:55:07,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-19 14:55:07,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last=1 2023-03-19 14:55:07,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:55:07,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230319/family1/d2d73d3ef72e4960b179d883d95b89cc to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__fet65hu47ru912v0tdtcrhjpno2upkm4j5qaoeoq43lf6uhmp7vdab1apanm09he/family1/d2d73d3ef72e4960b179d883d95b89cc 2023-03-19 14:55:07,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__fet65hu47ru912v0tdtcrhjpno2upkm4j5qaoeoq43lf6uhmp7vdab1apanm09he/family1/d2d73d3ef72e4960b179d883d95b89cc as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f93f7284745476eba28911e2c8a975f_SeqId_29_ 2023-03-19 14:55:07,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__fet65hu47ru912v0tdtcrhjpno2upkm4j5qaoeoq43lf6uhmp7vdab1apanm09he/family1/d2d73d3ef72e4960b179d883d95b89cc into f8e8d7cf2c5e169edcb3b943f53497bc/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f93f7284745476eba28911e2c8a975f_SeqId_29_ - updating store file list. 2023-03-19 14:55:07,950 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230319/family1/f67a41b0eba54449a3015de3126e1055 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-19 14:55:07,950 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230319/family1/f67a41b0eba54449a3015de3126e1055}] 2023-03-19 14:55:07,952 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230319/family1/f67a41b0eba54449a3015de3126e1055 for inclusion in affcc240214c2740e267f2d65797302f/family1 2023-03-19 14:55:07,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f93f7284745476eba28911e2c8a975f_SeqId_29_ into f8e8d7cf2c5e169edcb3b943f53497bc/family1 2023-03-19 14:55:07,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__fet65hu47ru912v0tdtcrhjpno2upkm4j5qaoeoq43lf6uhmp7vdab1apanm09he/family1/d2d73d3ef72e4960b179d883d95b89cc into f8e8d7cf2c5e169edcb3b943f53497bc/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f93f7284745476eba28911e2c8a975f_SeqId_29_) 2023-03-19 14:55:07,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__fet65hu47ru912v0tdtcrhjpno2upkm4j5qaoeoq43lf6uhmp7vdab1apanm09he/family1/d2d73d3ef72e4960b179d883d95b89cc 2023-03-19 14:55:07,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-19 14:55:07,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-19 14:55:07,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:55:07,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230319/family1/f67a41b0eba54449a3015de3126e1055 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__ojkob7vvskhna11149cqgtnc16b7l1gtnbo8760qgqaqdsa3f47of66vg9rtf1hn/family1/f67a41b0eba54449a3015de3126e1055 2023-03-19 14:55:07,957 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:07,957 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:07,958 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319313c4a0385ba497c82db271515476776 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319313c4a0385ba497c82db271515476776 2023-03-19 14:55:07,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__ojkob7vvskhna11149cqgtnc16b7l1gtnbo8760qgqaqdsa3f47of66vg9rtf1hn/family1/f67a41b0eba54449a3015de3126e1055 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/ed71768fa9274041a5eea32c5420a8b2_SeqId_29_ 2023-03-19 14:55:07,959 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__ojkob7vvskhna11149cqgtnc16b7l1gtnbo8760qgqaqdsa3f47of66vg9rtf1hn/family1/f67a41b0eba54449a3015de3126e1055 into affcc240214c2740e267f2d65797302f/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/ed71768fa9274041a5eea32c5420a8b2_SeqId_29_ - updating store file list. 2023-03-19 14:55:07,959 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319441f0e367e9d4ebc84549c754b858e07 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319441f0e367e9d4ebc84549c754b858e07 2023-03-19 14:55:07,960 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319979d3c583b1c44488ab75a41f6911c9e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319979d3c583b1c44488ab75a41f6911c9e 2023-03-19 14:55:07,961 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319af3b547e7c924811b007c5d7ad826535 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319af3b547e7c924811b007c5d7ad826535 2023-03-19 14:55:07,961 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-19 14:55:07,961 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230319' 2023-03-19 14:55:07,961 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:07,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/ed71768fa9274041a5eea32c5420a8b2_SeqId_29_ into affcc240214c2740e267f2d65797302f/family1 2023-03-19 14:55:07,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__ojkob7vvskhna11149cqgtnc16b7l1gtnbo8760qgqaqdsa3f47of66vg9rtf1hn/family1/f67a41b0eba54449a3015de3126e1055 into affcc240214c2740e267f2d65797302f/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/ed71768fa9274041a5eea32c5420a8b2_SeqId_29_) 2023-03-19 14:55:07,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__ojkob7vvskhna11149cqgtnc16b7l1gtnbo8760qgqaqdsa3f47of66vg9rtf1hn/family1/f67a41b0eba54449a3015de3126e1055 2023-03-19 14:55:07,964 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:07,964 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:07,965 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031920e6e46833924d0681cd5112740fe3a9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031920e6e46833924d0681cd5112740fe3a9 2023-03-19 14:55:07,966 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230319614dfba9fb484c17b78e7e0af5487225 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230319614dfba9fb484c17b78e7e0af5487225 2023-03-19 14:55:07,967 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031976cbb33d2823491d9d16b42fd681d5c5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031976cbb33d2823491d9d16b42fd681d5c5 2023-03-19 14:55:07,968 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031977e3d605883841a5b00c5f55ba694f64 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031977e3d605883841a5b00c5f55ba694f64 2023-03-19 14:55:07,968 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-19 14:55:07,968 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230319' 2023-03-19 14:55:07,968 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:07,968 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:07,968 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:07,968 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319bbdc4c70db1b454cb66e3a53b645f80a_del] 2023-03-19 14:55:07,969 DEBUG [Listener at localhost.localdomain/46521] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:07,970 DEBUG [Listener at localhost.localdomain/46521] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319bbdc4c70db1b454cb66e3a53b645f80a_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319bbdc4c70db1b454cb66e3a53b645f80a_del 2023-03-19 14:55:07,970 INFO [Listener at localhost.localdomain/46521] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-19 14:55:07,970 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303192efa984a363346b590ce9b315ab0e714_del] 2023-03-19 14:55:07,970 DEBUG [Listener at localhost.localdomain/46521] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:07,972 DEBUG [Listener at localhost.localdomain/46521] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303192efa984a363346b590ce9b315ab0e714_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303192efa984a363346b590ce9b315ab0e714_del 2023-03-19 14:55:07,972 INFO [Listener at localhost.localdomain/46521] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-19 14:55:07,972 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303195794bc1aa1f044578d14940b68d7a39e_del] 2023-03-19 14:55:07,972 DEBUG [Listener at localhost.localdomain/46521] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:07,973 DEBUG [Listener at localhost.localdomain/46521] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303195794bc1aa1f044578d14940b68d7a39e_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303195794bc1aa1f044578d14940b68d7a39e_del 2023-03-19 14:55:07,973 INFO [Listener at localhost.localdomain/46521] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-19 14:55:07,976 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:07,978 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:07,981 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:07,982 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:07,988 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-19 14:55:07,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-03-19 14:55:07,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-19 14:55:07,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-19 14:55:07,991 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237707991"}]},"ts":"1679237707991"} 2023-03-19 14:55:07,992 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-19 14:55:07,993 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-19 14:55:07,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, UNASSIGN}] 2023-03-19 14:55:07,995 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, UNASSIGN 2023-03-19 14:55:07,995 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, UNASSIGN 2023-03-19 14:55:07,996 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, UNASSIGN 2023-03-19 14:55:07,996 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=affcc240214c2740e267f2d65797302f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:07,996 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f8e8d7cf2c5e169edcb3b943f53497bc, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:07,996 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=9aa1fc0f1990ce625d14a4ce4d80764b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:07,996 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237707996"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237707996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237707996"}]},"ts":"1679237707996"} 2023-03-19 14:55:07,996 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237707996"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237707996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237707996"}]},"ts":"1679237707996"} 2023-03-19 14:55:07,996 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237707996"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237707996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237707996"}]},"ts":"1679237707996"} 2023-03-19 14:55:07,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure f8e8d7cf2c5e169edcb3b943f53497bc, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:07,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure affcc240214c2740e267f2d65797302f, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:07,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 9aa1fc0f1990ce625d14a4ce4d80764b, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:08,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-19 14:55:08,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:08,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f8e8d7cf2c5e169edcb3b943f53497bc, disabling compactions & flushes 2023-03-19 14:55:08,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:08,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:08,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. after waiting 0 ms 2023-03-19 14:55:08,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:08,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-19 14:55:08,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:08,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:55:08,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:08,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close affcc240214c2740e267f2d65797302f 2023-03-19 14:55:08,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing affcc240214c2740e267f2d65797302f, disabling compactions & flushes 2023-03-19 14:55:08,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:08,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:08,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. after waiting 0 ms 2023-03-19 14:55:08,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:08,156 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f8e8d7cf2c5e169edcb3b943f53497bc, regionState=CLOSED 2023-03-19 14:55:08,156 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237708156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237708156"}]},"ts":"1679237708156"} 2023-03-19 14:55:08,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=89 2023-03-19 14:55:08,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure f8e8d7cf2c5e169edcb3b943f53497bc, server=jenkins-hbase20.apache.org,33191,1679237584457 in 160 msec 2023-03-19 14:55:08,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, UNASSIGN in 165 msec 2023-03-19 14:55:08,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-19 14:55:08,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:08,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:55:08,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed affcc240214c2740e267f2d65797302f 2023-03-19 14:55:08,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:08,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9aa1fc0f1990ce625d14a4ce4d80764b, disabling compactions & flushes 2023-03-19 14:55:08,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:08,163 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=affcc240214c2740e267f2d65797302f, regionState=CLOSED 2023-03-19 14:55:08,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:08,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. after waiting 0 ms 2023-03-19 14:55:08,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:08,163 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237708163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237708163"}]},"ts":"1679237708163"} 2023-03-19 14:55:08,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-03-19 14:55:08,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure affcc240214c2740e267f2d65797302f, server=jenkins-hbase20.apache.org,33191,1679237584457 in 170 msec 2023-03-19 14:55:08,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-19 14:55:08,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:08,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:55:08,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, UNASSIGN in 174 msec 2023-03-19 14:55:08,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:08,172 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=9aa1fc0f1990ce625d14a4ce4d80764b, regionState=CLOSED 2023-03-19 14:55:08,172 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237708172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237708172"}]},"ts":"1679237708172"} 2023-03-19 14:55:08,173 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=90 2023-03-19 14:55:08,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 9aa1fc0f1990ce625d14a4ce4d80764b, server=jenkins-hbase20.apache.org,33191,1679237584457 in 175 msec 2023-03-19 14:55:08,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-03-19 14:55:08,175 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, UNASSIGN in 180 msec 2023-03-19 14:55:08,175 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237708175"}]},"ts":"1679237708175"} 2023-03-19 14:55:08,176 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-19 14:55:08,177 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-19 14:55:08,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 188 msec 2023-03-19 14:55:08,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-19 14:55:08,294 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-19 14:55:08,305 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1679237693667-1679237708305 2023-03-19 14:55:08,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-19 14:55:08,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1679237708306 (current time:1679237708306). 2023-03-19 14:55:08,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-19 14:55:08,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] zookeeper.ReadOnlyZKClient(139): Connect 0x6ccf43b3 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:55:08,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@142b08b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:55:08,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:55:08,313 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49166, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:55:08,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ccf43b3 to 127.0.0.1:56323 2023-03-19 14:55:08,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:55:08,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-19 14:55:08,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-19 14:55:08,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-19 14:55:08,317 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-19 14:55:08,318 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1679238308318 2023-03-19 14:55:08,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-19 14:55:08,318 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1679237693667-1679237708305 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-19 14:55:08,318 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:08,318 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-19 14:55:08,419 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:55:08,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:55:08,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-19 14:55:08,420 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-19 14:55:08,620 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:55:08,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:55:08,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-19 14:55:08,625 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-19 14:55:08,735 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-19 14:55:08,737 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-19 14:55:08,737 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-19 14:55:08,740 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/ed71768fa9274041a5eea32c5420a8b2_SeqId_29_, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/f1bedc25df4b4a4bbf74a9d83cb1c5c9] hfiles 2023-03-19 14:55:08,740 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/ed71768fa9274041a5eea32c5420a8b2_SeqId_29_ 2023-03-19 14:55:08,740 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/f1bedc25df4b4a4bbf74a9d83cb1c5c9 2023-03-19 14:55:08,741 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/150a69359bde4af58bb6876997caf859] hfiles 2023-03-19 14:55:08,741 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/150a69359bde4af58bb6876997caf859 2023-03-19 14:55:08,756 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-19 14:55:08,756 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-19 14:55:08,757 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-19 14:55:08,757 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-19 14:55:08,757 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-19 14:55:08,758 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-19 14:55:08,760 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031939397150d3f34204a891bb12dbdf5a61, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031960f5cdd9d6154619be7c20c446ee25b5, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031968745fa08ace4969bdb14aae5fc13f9a] hfiles 2023-03-19 14:55:08,760 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031939397150d3f34204a891bb12dbdf5a61 2023-03-19 14:55:08,760 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031960f5cdd9d6154619be7c20c446ee25b5 2023-03-19 14:55:08,760 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031968745fa08ace4969bdb14aae5fc13f9a 2023-03-19 14:55:08,761 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c451d7cab5104a0faedfc98f4be96b12, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c8b4eb5cde9c431c8c6a228432338974_SeqId_29_] hfiles 2023-03-19 14:55:08,765 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c451d7cab5104a0faedfc98f4be96b12 2023-03-19 14:55:08,765 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c8b4eb5cde9c431c8c6a228432338974_SeqId_29_ 2023-03-19 14:55:08,762 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/572c0bf606a2475c9716fa1d6d176e2a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f93f7284745476eba28911e2c8a975f_SeqId_29_] hfiles 2023-03-19 14:55:08,765 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/572c0bf606a2475c9716fa1d6d176e2a 2023-03-19 14:55:08,765 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f93f7284745476eba28911e2c8a975f_SeqId_29_ 2023-03-19 14:55:08,767 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/34b8d2ee03d14f78b82ef2fe1328471b] hfiles 2023-03-19 14:55:08,767 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/34b8d2ee03d14f78b82ef2fe1328471b 2023-03-19 14:55:08,767 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/73193623aa434c1c91ec3be6457405bd] hfiles 2023-03-19 14:55:08,768 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/73193623aa434c1c91ec3be6457405bd 2023-03-19 14:55:08,785 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031901aaa77200744fe1955e5325786c098c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230319094ee14fcb054002999931bb991e31fc_del, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303192b0c4b9bf9944dcf9fe2c4c119ef6a88, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303193fad9b1403f042bdaab1378904f92ea2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230319437c17dffd754379aef4dc8fb0a91269, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303191ca78181124f45c7b982628690f8e9eb, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031968235407d2b24f0d994b5825317eb9d9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303197934936ba7614f73b51187e269d8c895_del, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031991007cc831b9498c96faf4094d7906b0, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230319fabff725451b4dd6ad9e42f6b712c913, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031932fd42a9f7e744b19e7e25a7d3ba3e2b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031945e32c76090b4b809099d4656519018b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031946253ae3b4ba45f19f937c3b397cc1c8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303198a8ee595b9454d75a72ae4dc55785002, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230319f1b5815c66074fb99bb394ff2fb0eaf4_del] hfiles 2023-03-19 14:55:08,785 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031901aaa77200744fe1955e5325786c098c 2023-03-19 14:55:08,785 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230319094ee14fcb054002999931bb991e31fc_del 2023-03-19 14:55:08,785 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303192b0c4b9bf9944dcf9fe2c4c119ef6a88 2023-03-19 14:55:08,785 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303193fad9b1403f042bdaab1378904f92ea2 2023-03-19 14:55:08,785 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230319437c17dffd754379aef4dc8fb0a91269 2023-03-19 14:55:08,785 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303191ca78181124f45c7b982628690f8e9eb 2023-03-19 14:55:08,785 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031968235407d2b24f0d994b5825317eb9d9 2023-03-19 14:55:08,786 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303197934936ba7614f73b51187e269d8c895_del 2023-03-19 14:55:08,786 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023031991007cc831b9498c96faf4094d7906b0 2023-03-19 14:55:08,786 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230319fabff725451b4dd6ad9e42f6b712c913 2023-03-19 14:55:08,786 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031932fd42a9f7e744b19e7e25a7d3ba3e2b 2023-03-19 14:55:08,786 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031945e32c76090b4b809099d4656519018b 2023-03-19 14:55:08,786 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023031946253ae3b4ba45f19f937c3b397cc1c8 2023-03-19 14:55:08,786 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303198a8ee595b9454d75a72ae4dc55785002 2023-03-19 14:55:08,786 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230319f1b5815c66074fb99bb394ff2fb0eaf4_del 2023-03-19 14:55:08,925 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:55:08,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:55:08,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-19 14:55:08,927 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-19 14:55:09,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-19 14:55:09,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1679237693667-1679237708305 2023-03-19 14:55:09,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679237693667-1679237708305 2023-03-19 14:55:09,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679237693667-1679237708305 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/hbase-failsafe-snaptb-1679237693667-1679237708305 2023-03-19 14:55:09,427 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:55:09,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:55:09,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-19 14:55:09,428 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-19 14:55:09,707 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1679237693667-1679237708305 of table testCompactionWithHFileLink completed 2023-03-19 14:55:09,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679237693667-1679237708305 2023-03-19 14:55:09,707 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1679237693667-1679237708305 2023-03-19 14:55:09,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1679237693667-1679237708305 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1679237708318Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1679237708735 (+417 ms)Consolidate snapshot: hbase-failsafe-snaptb-1679237693667-1679237708305 at 1679237709205 (+470 ms)Loading Region manifests for hbase-failsafe-snaptb-1679237693667-1679237708305 at 1679237709205Writing data manifest for hbase-failsafe-snaptb-1679237693667-1679237708305 at 1679237709220 (+15 ms)Verifying snapshot: hbase-failsafe-snaptb-1679237693667-1679237708305 at 1679237709241 (+21 ms)Snapshot hbase-failsafe-snaptb-1679237693667-1679237708305 of table testCompactionWithHFileLink completed at 1679237709707 (+466 ms) 2023-03-19 14:55:09,708 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-19 14:55:09,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.3920 sec 2023-03-19 14:55:10,429 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-19 14:55:10,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-19 14:55:10,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1679237693667-1679237708305 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-19 14:55:10,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1679237693667" table: "testCompactionWithHFileLink" creation_time: 1679237693681 type: FLUSH version: 2 ttl: 0 ) 2023-03-19 14:55:10,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1679237693667 as table=testCompactionWithHFileLink 2023-03-19 14:55:10,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-19 14:55:10,513 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-19 14:55:10,513 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-19 14:55:10,514 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-19 14:55:10,515 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-19 14:55:10,520 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1679237693667" table: "testCompactionWithHFileLink" creation_time: 1679237693681 type: FLUSH version: 2 ttl: 0 2023-03-19 14:55:10,520 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink 2023-03-19 14:55:10,525 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-19 14:55:10,528 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031960f5cdd9d6154619be7c20c446ee25b5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031960f5cdd9d6154619be7c20c446ee25b5 2023-03-19 14:55:10,529 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031939397150d3f34204a891bb12dbdf5a61 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031939397150d3f34204a891bb12dbdf5a61 2023-03-19 14:55:10,530 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031968745fa08ace4969bdb14aae5fc13f9a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031968745fa08ace4969bdb14aae5fc13f9a 2023-03-19 14:55:10,530 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023031917b06df6292c4a93bc08efe28855f932 of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,533 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230319a445dc1c66df4f1b8f2f2e675e7a98ac of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,551 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230319ada91e6b0e594ddf99788c0f053b6833 of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,556 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230319c4f62dd3a5624bd391d53da21e831dd0 of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,561 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023031920e6e46833924d0681cd5112740fe3a9 of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,565 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230319614dfba9fb484c17b78e7e0af5487225 of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,574 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023031976cbb33d2823491d9d16b42fd681d5c5 of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,583 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023031977e3d605883841a5b00c5f55ba694f64 of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,589 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230319313c4a0385ba497c82db271515476776 of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,600 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230319441f0e367e9d4ebc84549c754b858e07 of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-19 14:55:10,612 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230319979d3c583b1c44488ab75a41f6911c9e of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,620 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230319af3b547e7c924811b007c5d7ad826535 of snapshot=snaptb-1679237693667 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-19 14:55:10,638 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230319094ee14fcb054002999931bb991e31fc_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230319094ee14fcb054002999931bb991e31fc_del 2023-03-19 14:55:10,640 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230319f1b5815c66074fb99bb394ff2fb0eaf4_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230319f1b5815c66074fb99bb394ff2fb0eaf4_del 2023-03-19 14:55:10,641 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303197934936ba7614f73b51187e269d8c895_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303197934936ba7614f73b51187e269d8c895_del 2023-03-19 14:55:10,641 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:10,641 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: affcc240214c2740e267f2d65797302f 2023-03-19 14:55:10,641 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:10,647 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/572c0bf606a2475c9716fa1d6d176e2a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/572c0bf606a2475c9716fa1d6d176e2a 2023-03-19 14:55:10,647 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c451d7cab5104a0faedfc98f4be96b12 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c451d7cab5104a0faedfc98f4be96b12 2023-03-19 14:55:10,649 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c8b4eb5cde9c431c8c6a228432338974_SeqId_29_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/c8b4eb5cde9c431c8c6a228432338974_SeqId_29_ 2023-03-19 14:55:10,650 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cc44908f6c5e427a90a6ca32334cf79e of snapshot=snaptb-1679237693667 to region=9aa1fc0f1990ce625d14a4ce4d80764b table=testCompactionWithHFileLink 2023-03-19 14:55:10,650 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f93f7284745476eba28911e2c8a975f_SeqId_29_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f93f7284745476eba28911e2c8a975f_SeqId_29_ 2023-03-19 14:55:10,650 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3135a14f577e414b895c137eda08f073 of snapshot=snaptb-1679237693667 to region=f8e8d7cf2c5e169edcb3b943f53497bc table=testCompactionWithHFileLink 2023-03-19 14:55:10,650 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/f1bedc25df4b4a4bbf74a9d83cb1c5c9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/f1bedc25df4b4a4bbf74a9d83cb1c5c9 2023-03-19 14:55:10,651 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/ed71768fa9274041a5eea32c5420a8b2_SeqId_29_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/ed71768fa9274041a5eea32c5420a8b2_SeqId_29_ 2023-03-19 14:55:10,651 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b8be95693f2a440380270ed0b7987057 of snapshot=snaptb-1679237693667 to region=affcc240214c2740e267f2d65797302f table=testCompactionWithHFileLink 2023-03-19 14:55:10,657 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 777791cd950945198d124edb3c132e17 of snapshot=snaptb-1679237693667 to region=affcc240214c2740e267f2d65797302f table=testCompactionWithHFileLink 2023-03-19 14:55:10,658 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a498a7af9de5499eb5506fb088e5ce4b of snapshot=snaptb-1679237693667 to region=9aa1fc0f1990ce625d14a4ce4d80764b table=testCompactionWithHFileLink 2023-03-19 14:55:10,662 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9586c74f287d4c8ab2dd569cecbaff4a of snapshot=snaptb-1679237693667 to region=f8e8d7cf2c5e169edcb3b943f53497bc table=testCompactionWithHFileLink 2023-03-19 14:55:10,668 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 71050ba6c89a4646b023b0f3e9b57686 of snapshot=snaptb-1679237693667 to region=affcc240214c2740e267f2d65797302f table=testCompactionWithHFileLink 2023-03-19 14:55:10,673 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 92eead09b38b4914801146ebd23ef20e of snapshot=snaptb-1679237693667 to region=9aa1fc0f1990ce625d14a4ce4d80764b table=testCompactionWithHFileLink 2023-03-19 14:55:10,682 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 22e271661cc847ccad251f5692d9f4cd of snapshot=snaptb-1679237693667 to region=f8e8d7cf2c5e169edcb3b943f53497bc table=testCompactionWithHFileLink 2023-03-19 14:55:10,685 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6ef705ae3af44268957e31b013687a4a of snapshot=snaptb-1679237693667 to region=9aa1fc0f1990ce625d14a4ce4d80764b table=testCompactionWithHFileLink 2023-03-19 14:55:10,687 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 64fb2a9331de4b59a3d3baba4334c565 of snapshot=snaptb-1679237693667 to region=affcc240214c2740e267f2d65797302f table=testCompactionWithHFileLink 2023-03-19 14:55:10,695 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 68dadd12b3e742a187daf4580db38d31 of snapshot=snaptb-1679237693667 to region=f8e8d7cf2c5e169edcb3b943f53497bc table=testCompactionWithHFileLink 2023-03-19 14:55:10,713 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/34b8d2ee03d14f78b82ef2fe1328471b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/34b8d2ee03d14f78b82ef2fe1328471b 2023-03-19 14:55:10,713 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 71b438b29ca74f3faa56c09a9678e0d7 of snapshot=snaptb-1679237693667 to region=9aa1fc0f1990ce625d14a4ce4d80764b table=testCompactionWithHFileLink 2023-03-19 14:55:10,717 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/150a69359bde4af58bb6876997caf859 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/150a69359bde4af58bb6876997caf859 2023-03-19 14:55:10,717 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fc2b5d5467204a3083e136b8718bf3e2 of snapshot=snaptb-1679237693667 to region=affcc240214c2740e267f2d65797302f table=testCompactionWithHFileLink 2023-03-19 14:55:10,720 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/73193623aa434c1c91ec3be6457405bd to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/73193623aa434c1c91ec3be6457405bd 2023-03-19 14:55:10,720 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2ef2f161f72b4885be16d467c2d07fee of snapshot=snaptb-1679237693667 to region=f8e8d7cf2c5e169edcb3b943f53497bc table=testCompactionWithHFileLink 2023-03-19 14:55:10,725 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 668221e186c0471ab0362e491d94547e of snapshot=snaptb-1679237693667 to region=9aa1fc0f1990ce625d14a4ce4d80764b table=testCompactionWithHFileLink 2023-03-19 14:55:10,739 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f9050243921745d7a421f54a78279f75 of snapshot=snaptb-1679237693667 to region=f8e8d7cf2c5e169edcb3b943f53497bc table=testCompactionWithHFileLink 2023-03-19 14:55:10,741 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c6e97c21949b4614ab1977b58cde91a6 of snapshot=snaptb-1679237693667 to region=affcc240214c2740e267f2d65797302f table=testCompactionWithHFileLink 2023-03-19 14:55:10,749 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f1eb51a16aea4f0da9b994008b59c96d of snapshot=snaptb-1679237693667 to region=9aa1fc0f1990ce625d14a4ce4d80764b table=testCompactionWithHFileLink 2023-03-19 14:55:10,750 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2452702cd07d48e5b34a29b501705fbd of snapshot=snaptb-1679237693667 to region=f8e8d7cf2c5e169edcb3b943f53497bc table=testCompactionWithHFileLink 2023-03-19 14:55:10,753 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink eec30539054d4e3cae38aa42c55dc97e of snapshot=snaptb-1679237693667 to region=9aa1fc0f1990ce625d14a4ce4d80764b table=testCompactionWithHFileLink 2023-03-19 14:55:10,763 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d9c52dbb54df402e84d848dbe0313e1d of snapshot=snaptb-1679237693667 to region=affcc240214c2740e267f2d65797302f table=testCompactionWithHFileLink 2023-03-19 14:55:10,764 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9ab446dfd8214726af29869a4bc019f0 of snapshot=snaptb-1679237693667 to region=f8e8d7cf2c5e169edcb3b943f53497bc table=testCompactionWithHFileLink 2023-03-19 14:55:10,767 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 79c100f393d54da7814436e728b5ff49 of snapshot=snaptb-1679237693667 to region=affcc240214c2740e267f2d65797302f table=testCompactionWithHFileLink 2023-03-19 14:55:10,772 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1679237693667" table: "testCompactionWithHFileLink" creation_time: 1679237693681 type: FLUSH version: 2 ttl: 0 2023-03-19 14:55:10,773 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679237710773"}]},"ts":"9223372036854775807"} 2023-03-19 14:55:10,773 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679237710773"}]},"ts":"9223372036854775807"} 2023-03-19 14:55:10,773 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1679237710773"}]},"ts":"9223372036854775807"} 2023-03-19 14:55:10,775 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-19 14:55:10,775 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9aa1fc0f1990ce625d14a4ce4d80764b, NAME => 'testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => affcc240214c2740e267f2d65797302f, NAME => 'testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => f8e8d7cf2c5e169edcb3b943f53497bc, NAME => 'testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.', STARTKEY => '', ENDKEY => '1'}] 2023-03-19 14:55:10,775 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237710774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237710774"}]},"ts":"1679237710774"} 2023-03-19 14:55:10,776 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237710774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237710774"}]},"ts":"1679237710774"} 2023-03-19 14:55:10,776 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237710774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237710774"}]},"ts":"1679237710774"} 2023-03-19 14:55:10,778 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-19 14:55:10,778 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-19 14:55:10,778 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 9aa1fc0f1990ce625d14a4ce4d80764b, NAME => 'testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => affcc240214c2740e267f2d65797302f, NAME => 'testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => f8e8d7cf2c5e169edcb3b943f53497bc, NAME => 'testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.', STARTKEY => '', ENDKEY => '1'}] 2023-03-19 14:55:10,778 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1679237693667 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-19 14:55:10,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1679237693667" table: "testCompactionWithHFileLink" creation_time: 1679237693681 type: FLUSH version: 2 ttl: 0 ) in 291 msec 2023-03-19 14:55:10,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-19 14:55:10,805 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-19 14:55:10,806 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1679237693667-1679237708305 2023-03-19 14:55:10,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1679237693667-1679237708305" 2023-03-19 14:55:10,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1679237693667-1679237708305 2023-03-19 14:55:10,816 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-19 14:55:10,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-03-19 14:55:10,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-19 14:55:10,831 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-19 14:55:10,831 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237710831"}]},"ts":"1679237710831"} 2023-03-19 14:55:10,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-19 14:55:10,832 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-19 14:55:10,833 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-19 14:55:10,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, ASSIGN}] 2023-03-19 14:55:10,836 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, ASSIGN 2023-03-19 14:55:10,836 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, ASSIGN 2023-03-19 14:55:10,836 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, ASSIGN 2023-03-19 14:55:10,837 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-19 14:55:10,837 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-19 14:55:10,837 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-19 14:55:10,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-19 14:55:10,988 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=affcc240214c2740e267f2d65797302f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:10,989 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237710988"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237710988"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237710988"}]},"ts":"1679237710988"} 2023-03-19 14:55:10,989 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=9aa1fc0f1990ce625d14a4ce4d80764b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:10,989 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237710989"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237710989"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237710989"}]},"ts":"1679237710989"} 2023-03-19 14:55:10,989 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f8e8d7cf2c5e169edcb3b943f53497bc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:10,989 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237710989"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237710989"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237710989"}]},"ts":"1679237710989"} 2023-03-19 14:55:10,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 9aa1fc0f1990ce625d14a4ce4d80764b, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:10,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure affcc240214c2740e267f2d65797302f, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:10,992 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure f8e8d7cf2c5e169edcb3b943f53497bc, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:11,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-19 14:55:11,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:11,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => affcc240214c2740e267f2d65797302f, NAME => 'testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.', STARTKEY => '2', ENDKEY => ''} 2023-03-19 14:55:11,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink affcc240214c2740e267f2d65797302f 2023-03-19 14:55:11,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:11,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for affcc240214c2740e267f2d65797302f 2023-03-19 14:55:11,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for affcc240214c2740e267f2d65797302f 2023-03-19 14:55:11,148 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region affcc240214c2740e267f2d65797302f 2023-03-19 14:55:11,149 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1 2023-03-19 14:55:11,149 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1 2023-03-19 14:55:11,149 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region affcc240214c2740e267f2d65797302f columnFamilyName family1 2023-03-19 14:55:11,170 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-64fb2a9331de4b59a3d3baba4334c565 2023-03-19 14:55:11,186 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-71050ba6c89a4646b023b0f3e9b57686 2023-03-19 14:55:11,194 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-777791cd950945198d124edb3c132e17 2023-03-19 14:55:11,201 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-b8be95693f2a440380270ed0b7987057 2023-03-19 14:55:11,202 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(310): Store=affcc240214c2740e267f2d65797302f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:11,202 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region affcc240214c2740e267f2d65797302f 2023-03-19 14:55:11,203 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2 2023-03-19 14:55:11,203 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2 2023-03-19 14:55:11,204 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region affcc240214c2740e267f2d65797302f columnFamilyName family2 2023-03-19 14:55:11,220 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-79c100f393d54da7814436e728b5ff49 2023-03-19 14:55:11,248 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-c6e97c21949b4614ab1977b58cde91a6 2023-03-19 14:55:11,257 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-d9c52dbb54df402e84d848dbe0313e1d 2023-03-19 14:55:11,269 DEBUG [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-fc2b5d5467204a3083e136b8718bf3e2 2023-03-19 14:55:11,269 INFO [StoreOpener-affcc240214c2740e267f2d65797302f-1] regionserver.HStore(310): Store=affcc240214c2740e267f2d65797302f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:11,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f 2023-03-19 14:55:11,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f 2023-03-19 14:55:11,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:55:11,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for affcc240214c2740e267f2d65797302f 2023-03-19 14:55:11,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened affcc240214c2740e267f2d65797302f; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59218494, jitterRate=-0.11757567524909973}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:55:11,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:55:11,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f., pid=102, masterSystemTime=1679237711142 2023-03-19 14:55:11,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:55:11,284 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-19 14:55:11,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-19 14:55:11,285 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-19 14:55:11,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:11,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:11,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:11,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f8e8d7cf2c5e169edcb3b943f53497bc, NAME => 'testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.', STARTKEY => '', ENDKEY => '1'} 2023-03-19 14:55:11,286 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=affcc240214c2740e267f2d65797302f, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:11,286 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237711286"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237711286"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237711286"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237711286"}]},"ts":"1679237711286"} 2023-03-19 14:55:11,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:11,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:11,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:11,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:11,287 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-19 14:55:11,287 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1912): affcc240214c2740e267f2d65797302f/family1 is initiating minor compaction (all files) 2023-03-19 14:55:11,288 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of affcc240214c2740e267f2d65797302f/family1 in testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:11,288 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-b8be95693f2a440380270ed0b7987057, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-777791cd950945198d124edb3c132e17, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-71050ba6c89a4646b023b0f3e9b57686, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-64fb2a9331de4b59a3d3baba4334c565] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp, totalSize=21.6 K 2023-03-19 14:55:11,288 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-19 14:55:11,288 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:11,288 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1912): affcc240214c2740e267f2d65797302f/family2 is initiating minor compaction (all files) 2023-03-19 14:55:11,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-03-19 14:55:11,288 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2259): Starting compaction of affcc240214c2740e267f2d65797302f/family2 in testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:11,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure affcc240214c2740e267f2d65797302f, server=jenkins-hbase20.apache.org,33191,1679237584457 in 296 msec 2023-03-19 14:55:11,288 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-fc2b5d5467204a3083e136b8718bf3e2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-c6e97c21949b4614ab1977b58cde91a6, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-d9c52dbb54df402e84d848dbe0313e1d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-79c100f393d54da7814436e728b5ff49] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp, totalSize=20.4 K 2023-03-19 14:55:11,289 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-b8be95693f2a440380270ed0b7987057, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687108 2023-03-19 14:55:11,289 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-fc2b5d5467204a3083e136b8718bf3e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687108 2023-03-19 14:55:11,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=affcc240214c2740e267f2d65797302f, ASSIGN in 455 msec 2023-03-19 14:55:11,289 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1 2023-03-19 14:55:11,289 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-777791cd950945198d124edb3c132e17, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688922 2023-03-19 14:55:11,289 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1 2023-03-19 14:55:11,290 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e8d7cf2c5e169edcb3b943f53497bc columnFamilyName family1 2023-03-19 14:55:11,292 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-c6e97c21949b4614ab1977b58cde91a6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688922 2023-03-19 14:55:11,292 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-71050ba6c89a4646b023b0f3e9b57686, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:11,293 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-d9c52dbb54df402e84d848dbe0313e1d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:11,293 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-79c100f393d54da7814436e728b5ff49, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692229 2023-03-19 14:55:11,293 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-64fb2a9331de4b59a3d3baba4334c565, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692229 2023-03-19 14:55:11,311 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-22e271661cc847ccad251f5692d9f4cd 2023-03-19 14:55:11,325 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-3135a14f577e414b895c137eda08f073 2023-03-19 14:55:11,329 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): affcc240214c2740e267f2d65797302f#family1#compaction#114 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-19 14:55:11,350 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-68dadd12b3e742a187daf4580db38d31 2023-03-19 14:55:11,356 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] throttle.PressureAwareThroughputController(145): affcc240214c2740e267f2d65797302f#family2#compaction#115 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-19 14:55:11,373 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9586c74f287d4c8ab2dd569cecbaff4a 2023-03-19 14:55:11,373 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(310): Store=f8e8d7cf2c5e169edcb3b943f53497bc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:11,373 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:11,374 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2 2023-03-19 14:55:11,374 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2 2023-03-19 14:55:11,375 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e8d7cf2c5e169edcb3b943f53497bc columnFamilyName family2 2023-03-19 14:55:11,382 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2452702cd07d48e5b34a29b501705fbd 2023-03-19 14:55:11,395 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2ef2f161f72b4885be16d467c2d07fee 2023-03-19 14:55:11,400 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9ab446dfd8214726af29869a4bc019f0 2023-03-19 14:55:11,404 DEBUG [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-f9050243921745d7a421f54a78279f75 2023-03-19 14:55:11,404 INFO [StoreOpener-f8e8d7cf2c5e169edcb3b943f53497bc-1] regionserver.HStore(310): Store=f8e8d7cf2c5e169edcb3b943f53497bc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:11,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:11,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:11,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:55:11,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:11,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f8e8d7cf2c5e169edcb3b943f53497bc; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71317570, jitterRate=0.0627146065235138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:55:11,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:55:11,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc., pid=103, masterSystemTime=1679237711142 2023-03-19 14:55:11,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-19 14:55:11,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-19 14:55:11,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:11,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:11,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:11,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9aa1fc0f1990ce625d14a4ce4d80764b, NAME => 'testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.', STARTKEY => '1', ENDKEY => '2'} 2023-03-19 14:55:11,410 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f8e8d7cf2c5e169edcb3b943f53497bc, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:11,411 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1679237711410"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237711410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237711410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237711410"}]},"ts":"1679237711410"} 2023-03-19 14:55:11,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:11,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:11,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:11,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:11,412 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:11,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-03-19 14:55:11,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure f8e8d7cf2c5e169edcb3b943f53497bc, server=jenkins-hbase20.apache.org,33191,1679237584457 in 419 msec 2023-03-19 14:55:11,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f8e8d7cf2c5e169edcb3b943f53497bc, ASSIGN in 580 msec 2023-03-19 14:55:11,421 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1 2023-03-19 14:55:11,421 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1 2023-03-19 14:55:11,422 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aa1fc0f1990ce625d14a4ce4d80764b columnFamilyName family1 2023-03-19 14:55:11,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-19 14:55:11,439 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-6ef705ae3af44268957e31b013687a4a 2023-03-19 14:55:11,450 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-92eead09b38b4914801146ebd23ef20e 2023-03-19 14:55:11,468 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-a498a7af9de5499eb5506fb088e5ce4b 2023-03-19 14:55:11,475 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-cc44908f6c5e427a90a6ca32334cf79e 2023-03-19 14:55:11,475 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(310): Store=9aa1fc0f1990ce625d14a4ce4d80764b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:11,476 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:11,478 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2 2023-03-19 14:55:11,478 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2 2023-03-19 14:55:11,478 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9aa1fc0f1990ce625d14a4ce4d80764b columnFamilyName family2 2023-03-19 14:55:11,501 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-668221e186c0471ab0362e491d94547e 2023-03-19 14:55:11,514 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-71b438b29ca74f3faa56c09a9678e0d7 2023-03-19 14:55:11,527 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-eec30539054d4e3cae38aa42c55dc97e 2023-03-19 14:55:11,537 DEBUG [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-f1eb51a16aea4f0da9b994008b59c96d 2023-03-19 14:55:11,538 INFO [StoreOpener-9aa1fc0f1990ce625d14a4ce4d80764b-1] regionserver.HStore(310): Store=9aa1fc0f1990ce625d14a4ce4d80764b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:11,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:11,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:11,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:55:11,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:11,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9aa1fc0f1990ce625d14a4ce4d80764b; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75074487, jitterRate=0.11869703233242035}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:55:11,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:55:11,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b., pid=101, masterSystemTime=1679237711142 2023-03-19 14:55:11,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-19 14:55:11,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-19 14:55:11,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:11,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:11,545 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=9aa1fc0f1990ce625d14a4ce4d80764b, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:11,545 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237711544"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237711544"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237711544"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237711544"}]},"ts":"1679237711544"} 2023-03-19 14:55:11,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-03-19 14:55:11,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 9aa1fc0f1990ce625d14a4ce4d80764b, server=jenkins-hbase20.apache.org,33191,1679237584457 in 555 msec 2023-03-19 14:55:11,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-03-19 14:55:11,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9aa1fc0f1990ce625d14a4ce4d80764b, ASSIGN in 715 msec 2023-03-19 14:55:11,549 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237711549"}]},"ts":"1679237711549"} 2023-03-19 14:55:11,550 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-19 14:55:11,551 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-19 14:55:11,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 729 msec 2023-03-19 14:55:11,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-19 14:55:11,935 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-19 14:55:11,950 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:11,971 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:11,984 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:11,985 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:12,005 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-19 14:55:12,040 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-19 14:55:12,040 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:12,041 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ReadOnlyZKClient(139): Connect 0x1aadab53 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:55:12,053 DEBUG [Listener at localhost.localdomain/46521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45d32a45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:55:12,054 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:12,054 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:12,054 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:12,206 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family2/28917179aec34eb09498e771c60c322c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/28917179aec34eb09498e771c60c322c 2023-03-19 14:55:12,210 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in affcc240214c2740e267f2d65797302f/family2 of affcc240214c2740e267f2d65797302f into 28917179aec34eb09498e771c60c322c(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:12,211 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:55:12,211 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f., storeName=affcc240214c2740e267f2d65797302f/family2, priority=12, startTime=1679237711285; duration=0sec 2023-03-19 14:55:12,211 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-19 14:55:12,211 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-19 14:55:12,215 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-19 14:55:12,215 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1912): f8e8d7cf2c5e169edcb3b943f53497bc/family1 is initiating minor compaction (all files) 2023-03-19 14:55:12,215 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f8e8d7cf2c5e169edcb3b943f53497bc/family1 in testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:12,215 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-3135a14f577e414b895c137eda08f073, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9586c74f287d4c8ab2dd569cecbaff4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-22e271661cc847ccad251f5692d9f4cd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-68dadd12b3e742a187daf4580db38d31] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp, totalSize=21.6 K 2023-03-19 14:55:12,216 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-3135a14f577e414b895c137eda08f073, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687106 2023-03-19 14:55:12,216 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9586c74f287d4c8ab2dd569cecbaff4a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688921 2023-03-19 14:55:12,217 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-22e271661cc847ccad251f5692d9f4cd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:12,222 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-68dadd12b3e742a187daf4580db38d31, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692228 2023-03-19 14:55:12,250 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] throttle.PressureAwareThroughputController(145): f8e8d7cf2c5e169edcb3b943f53497bc#family1#compaction#116 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-19 14:55:12,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-fc2b5d5467204a3083e136b8718bf3e2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-c6e97c21949b4614ab1977b58cde91a6, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-d9c52dbb54df402e84d848dbe0313e1d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-79c100f393d54da7814436e728b5ff49] to archive 2023-03-19 14:55:12,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:12,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-fc2b5d5467204a3083e136b8718bf3e2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-fc2b5d5467204a3083e136b8718bf3e2 2023-03-19 14:55:12,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-c6e97c21949b4614ab1977b58cde91a6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-c6e97c21949b4614ab1977b58cde91a6 2023-03-19 14:55:12,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-d9c52dbb54df402e84d848dbe0313e1d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-d9c52dbb54df402e84d848dbe0313e1d 2023-03-19 14:55:12,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-79c100f393d54da7814436e728b5ff49 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family2/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-79c100f393d54da7814436e728b5ff49 2023-03-19 14:55:12,584 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303190a96ae32300c4e9f94aab5a49b7507a8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303190a96ae32300c4e9f94aab5a49b7507a8 2023-03-19 14:55:12,584 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/.tmp/family1/ff029f9404e5454192811ffa7c4fde03 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/ff029f9404e5454192811ffa7c4fde03 2023-03-19 14:55:12,585 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:12,595 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in affcc240214c2740e267f2d65797302f/family1 of affcc240214c2740e267f2d65797302f into ff029f9404e5454192811ffa7c4fde03(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:12,596 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:55:12,596 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f., storeName=affcc240214c2740e267f2d65797302f/family1, priority=12, startTime=1679237711284; duration=1sec 2023-03-19 14:55:12,596 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-19 14:55:12,597 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-19 14:55:12,602 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-19 14:55:12,602 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:55:12,602 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1912): 9aa1fc0f1990ce625d14a4ce4d80764b/family2 is initiating minor compaction (all files) 2023-03-19 14:55:12,603 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9aa1fc0f1990ce625d14a4ce4d80764b/family2 in testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:12,603 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-71b438b29ca74f3faa56c09a9678e0d7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-668221e186c0471ab0362e491d94547e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-f1eb51a16aea4f0da9b994008b59c96d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-eec30539054d4e3cae38aa42c55dc97e] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp, totalSize=20.4 K 2023-03-19 14:55:12,603 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319069214223f244a9daebe01ff759ff6c7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230319069214223f244a9daebe01ff759ff6c7 2023-03-19 14:55:12,609 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:12,609 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-71b438b29ca74f3faa56c09a9678e0d7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687107 2023-03-19 14:55:12,613 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031915ac276352c24357ba540b8728273aa7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023031915ac276352c24357ba540b8728273aa7 2023-03-19 14:55:12,615 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:12,616 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-668221e186c0471ab0362e491d94547e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688921 2023-03-19 14:55:12,616 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40012, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:55:12,616 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-f1eb51a16aea4f0da9b994008b59c96d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:12,617 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-eec30539054d4e3cae38aa42c55dc97e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692229 2023-03-19 14:55:12,625 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:55:12,637 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41372, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:55:12,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-b8be95693f2a440380270ed0b7987057, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-777791cd950945198d124edb3c132e17, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-71050ba6c89a4646b023b0f3e9b57686, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-64fb2a9331de4b59a3d3baba4334c565] to archive 2023-03-19 14:55:12,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:12,668 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9aa1fc0f1990ce625d14a4ce4d80764b#family2#compaction#117 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-19 14:55:12,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-b8be95693f2a440380270ed0b7987057 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-b8be95693f2a440380270ed0b7987057 2023-03-19 14:55:12,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-777791cd950945198d124edb3c132e17 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-777791cd950945198d124edb3c132e17 2023-03-19 14:55:12,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-71050ba6c89a4646b023b0f3e9b57686 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-71050ba6c89a4646b023b0f3e9b57686 2023-03-19 14:55:12,685 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230319/family1/da7337adc3ac4895802f1d434ba361da first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-19 14:55:12,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-64fb2a9331de4b59a3d3baba4334c565 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/testCompactionWithHFileLink=affcc240214c2740e267f2d65797302f-64fb2a9331de4b59a3d3baba4334c565 2023-03-19 14:55:12,694 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230319/family1/da7337adc3ac4895802f1d434ba361da}] 2023-03-19 14:55:12,694 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230319/family1/fc1e54b11d174fa195a2dcd7b98ebd1e first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-19 14:55:12,695 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230319/family1/fc1e54b11d174fa195a2dcd7b98ebd1e}] 2023-03-19 14:55:12,707 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230319/family1/da7337adc3ac4895802f1d434ba361da for inclusion in affcc240214c2740e267f2d65797302f/family1 2023-03-19 14:55:12,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230319/family1/fc1e54b11d174fa195a2dcd7b98ebd1e for inclusion in f8e8d7cf2c5e169edcb3b943f53497bc/family1 2023-03-19 14:55:12,708 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230319/family1/780175c9206847c380b34775eea5aae4 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-19 14:55:12,709 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230319/family1/780175c9206847c380b34775eea5aae4}] 2023-03-19 14:55:12,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-19 14:55:12,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-19 14:55:12,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-19 14:55:12,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last=1 2023-03-19 14:55:12,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:55:12,712 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230319/family1/780175c9206847c380b34775eea5aae4 for inclusion in 9aa1fc0f1990ce625d14a4ce4d80764b/family1 2023-03-19 14:55:12,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:55:12,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230319/family1/da7337adc3ac4895802f1d434ba361da to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__km1jcs3oevkq6iqbh1shockh9hpph8rub10e7j4hd6h0kb585t97nld6rk3hllds/family1/da7337adc3ac4895802f1d434ba361da 2023-03-19 14:55:12,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230319/family1/fc1e54b11d174fa195a2dcd7b98ebd1e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__19g0sn2bv6v0heqde4c1rl52dt4sv3lomj2f1p9k0j4bh3j39udg95rj1pg0vl78/family1/fc1e54b11d174fa195a2dcd7b98ebd1e 2023-03-19 14:55:12,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-19 14:55:12,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-19 14:55:12,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:55:12,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230319/family1/780175c9206847c380b34775eea5aae4 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__11viep9u0qr16porj0srhr7hj1fngi03qtkp4sa6bhfq2on60c8gr7o53tt6vqmp/family1/780175c9206847c380b34775eea5aae4 2023-03-19 14:55:12,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__19g0sn2bv6v0heqde4c1rl52dt4sv3lomj2f1p9k0j4bh3j39udg95rj1pg0vl78/family1/fc1e54b11d174fa195a2dcd7b98ebd1e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f25e82c9b6746c69650bbe50bb6f889_SeqId_34_ 2023-03-19 14:55:12,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__11viep9u0qr16porj0srhr7hj1fngi03qtkp4sa6bhfq2on60c8gr7o53tt6vqmp/family1/780175c9206847c380b34775eea5aae4 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/75b37be38cbd483e89962da78ab4bf04_SeqId_34_ 2023-03-19 14:55:12,721 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__11viep9u0qr16porj0srhr7hj1fngi03qtkp4sa6bhfq2on60c8gr7o53tt6vqmp/family1/780175c9206847c380b34775eea5aae4 into 9aa1fc0f1990ce625d14a4ce4d80764b/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/75b37be38cbd483e89962da78ab4bf04_SeqId_34_ - updating store file list. 2023-03-19 14:55:12,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__19g0sn2bv6v0heqde4c1rl52dt4sv3lomj2f1p9k0j4bh3j39udg95rj1pg0vl78/family1/fc1e54b11d174fa195a2dcd7b98ebd1e into f8e8d7cf2c5e169edcb3b943f53497bc/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f25e82c9b6746c69650bbe50bb6f889_SeqId_34_ - updating store file list. 2023-03-19 14:55:12,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__km1jcs3oevkq6iqbh1shockh9hpph8rub10e7j4hd6h0kb585t97nld6rk3hllds/family1/da7337adc3ac4895802f1d434ba361da as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/16fee3ff4e414e0d83f7364763724b6a_SeqId_36_ 2023-03-19 14:55:12,722 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__km1jcs3oevkq6iqbh1shockh9hpph8rub10e7j4hd6h0kb585t97nld6rk3hllds/family1/da7337adc3ac4895802f1d434ba361da into affcc240214c2740e267f2d65797302f/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/16fee3ff4e414e0d83f7364763724b6a_SeqId_36_ - updating store file list. 2023-03-19 14:55:12,733 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family1/6276d807c1924e50b646e5de0b8c21e2 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/6276d807c1924e50b646e5de0b8c21e2 2023-03-19 14:55:12,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f25e82c9b6746c69650bbe50bb6f889_SeqId_34_ into f8e8d7cf2c5e169edcb3b943f53497bc/family1 2023-03-19 14:55:12,733 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/75b37be38cbd483e89962da78ab4bf04_SeqId_34_ into 9aa1fc0f1990ce625d14a4ce4d80764b/family1 2023-03-19 14:55:12,734 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__11viep9u0qr16porj0srhr7hj1fngi03qtkp4sa6bhfq2on60c8gr7o53tt6vqmp/family1/780175c9206847c380b34775eea5aae4 into 9aa1fc0f1990ce625d14a4ce4d80764b/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/75b37be38cbd483e89962da78ab4bf04_SeqId_34_) 2023-03-19 14:55:12,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__19g0sn2bv6v0heqde4c1rl52dt4sv3lomj2f1p9k0j4bh3j39udg95rj1pg0vl78/family1/fc1e54b11d174fa195a2dcd7b98ebd1e into f8e8d7cf2c5e169edcb3b943f53497bc/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/9f25e82c9b6746c69650bbe50bb6f889_SeqId_34_) 2023-03-19 14:55:12,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__11viep9u0qr16porj0srhr7hj1fngi03qtkp4sa6bhfq2on60c8gr7o53tt6vqmp/family1/780175c9206847c380b34775eea5aae4 2023-03-19 14:55:12,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__19g0sn2bv6v0heqde4c1rl52dt4sv3lomj2f1p9k0j4bh3j39udg95rj1pg0vl78/family1/fc1e54b11d174fa195a2dcd7b98ebd1e 2023-03-19 14:55:12,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:12,738 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/16fee3ff4e414e0d83f7364763724b6a_SeqId_36_ into affcc240214c2740e267f2d65797302f/family1 2023-03-19 14:55:12,738 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__km1jcs3oevkq6iqbh1shockh9hpph8rub10e7j4hd6h0kb585t97nld6rk3hllds/family1/da7337adc3ac4895802f1d434ba361da into affcc240214c2740e267f2d65797302f/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/family1/16fee3ff4e414e0d83f7364763724b6a_SeqId_36_) 2023-03-19 14:55:12,738 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:12,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testCompactionWithHFileLink__km1jcs3oevkq6iqbh1shockh9hpph8rub10e7j4hd6h0kb585t97nld6rk3hllds/family1/da7337adc3ac4895802f1d434ba361da 2023-03-19 14:55:12,739 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:12,739 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f8e8d7cf2c5e169edcb3b943f53497bc/family1 of f8e8d7cf2c5e169edcb3b943f53497bc into 6276d807c1924e50b646e5de0b8c21e2(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:12,739 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:55:12,739 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc., storeName=f8e8d7cf2c5e169edcb3b943f53497bc/family1, priority=12, startTime=1679237711409; duration=0sec 2023-03-19 14:55:12,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-19 14:55:12,740 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230319313c4a0385ba497c82db271515476776 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230319313c4a0385ba497c82db271515476776 2023-03-19 14:55:12,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(1912): 9aa1fc0f1990ce625d14a4ce4d80764b/family1 is initiating minor compaction (all files) 2023-03-19 14:55:12,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@780b7163; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-19 14:55:12,740 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-19 14:55:12,740 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 9aa1fc0f1990ce625d14a4ce4d80764b/family1 in testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:12,741 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-cc44908f6c5e427a90a6ca32334cf79e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-a498a7af9de5499eb5506fb088e5ce4b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-92eead09b38b4914801146ebd23ef20e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-6ef705ae3af44268957e31b013687a4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/75b37be38cbd483e89962da78ab4bf04_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp, totalSize=28.9 K 2023-03-19 14:55:12,741 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:12,741 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230319441f0e367e9d4ebc84549c754b858e07 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230319441f0e367e9d4ebc84549c754b858e07 2023-03-19 14:55:12,742 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:12,742 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-cc44908f6c5e427a90a6ca32334cf79e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687107 2023-03-19 14:55:12,742 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-a498a7af9de5499eb5506fb088e5ce4b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688921 2023-03-19 14:55:12,742 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230319 table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:12,743 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230319979d3c583b1c44488ab75a41f6911c9e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230319979d3c583b1c44488ab75a41f6911c9e 2023-03-19 14:55:12,743 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-92eead09b38b4914801146ebd23ef20e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:12,743 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:12,744 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023031920e6e46833924d0681cd5112740fe3a9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023031920e6e46833924d0681cd5112740fe3a9 2023-03-19 14:55:12,744 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family2/f0cde0d597e94fdf9d4227ca48276238 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/f0cde0d597e94fdf9d4227ca48276238 2023-03-19 14:55:12,744 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-6ef705ae3af44268957e31b013687a4a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692229 2023-03-19 14:55:12,744 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] compactions.Compactor(207): Compacting 75b37be38cbd483e89962da78ab4bf04_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1679237687107 2023-03-19 14:55:12,745 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230319614dfba9fb484c17b78e7e0af5487225 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230319614dfba9fb484c17b78e7e0af5487225 2023-03-19 14:55:12,745 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230319af3b547e7c924811b007c5d7ad826535 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230319af3b547e7c924811b007c5d7ad826535 2023-03-19 14:55:12,745 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-19 14:55:12,745 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230319' 2023-03-19 14:55:12,745 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023031917b06df6292c4a93bc08efe28855f932 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023031917b06df6292c4a93bc08efe28855f932 2023-03-19 14:55:12,745 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:12,746 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023031976cbb33d2823491d9d16b42fd681d5c5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023031976cbb33d2823491d9d16b42fd681d5c5 2023-03-19 14:55:12,746 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230319a445dc1c66df4f1b8f2f2e675e7a98ac to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230319a445dc1c66df4f1b8f2f2e675e7a98ac 2023-03-19 14:55:12,747 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023031977e3d605883841a5b00c5f55ba694f64 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023031977e3d605883841a5b00c5f55ba694f64 2023-03-19 14:55:12,747 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-19 14:55:12,747 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230319ada91e6b0e594ddf99788c0f053b6833 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230319ada91e6b0e594ddf99788c0f053b6833 2023-03-19 14:55:12,747 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230319' 2023-03-19 14:55:12,748 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:12,748 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230319c4f62dd3a5624bd391d53da21e831dd0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230319c4f62dd3a5624bd391d53da21e831dd0 2023-03-19 14:55:12,748 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-19 14:55:12,748 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230319' 2023-03-19 14:55:12,748 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230319 for table='testCompactionWithHFileLink' and column='family1' 2023-03-19 14:55:12,748 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-19 14:55:12,748 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9aa1fc0f1990ce625d14a4ce4d80764b/family2 of 9aa1fc0f1990ce625d14a4ce4d80764b into f0cde0d597e94fdf9d4227ca48276238(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:12,748 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:55:12,749 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b., storeName=9aa1fc0f1990ce625d14a4ce4d80764b/family2, priority=12, startTime=1679237711543; duration=0sec 2023-03-19 14:55:12,749 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-19 14:55:12,749 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-03-19 14:55:12,749 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-19 14:55:12,749 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-19 14:55:12,749 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. because compaction request was cancelled 2023-03-19 14:55:12,750 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-19 14:55:12,753 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:12,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-71b438b29ca74f3faa56c09a9678e0d7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-668221e186c0471ab0362e491d94547e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-f1eb51a16aea4f0da9b994008b59c96d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-eec30539054d4e3cae38aa42c55dc97e] to archive 2023-03-19 14:55:12,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:12,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-71b438b29ca74f3faa56c09a9678e0d7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-71b438b29ca74f3faa56c09a9678e0d7 2023-03-19 14:55:12,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-668221e186c0471ab0362e491d94547e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-668221e186c0471ab0362e491d94547e 2023-03-19 14:55:12,765 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-19 14:55:12,765 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1912): f8e8d7cf2c5e169edcb3b943f53497bc/family2 is initiating minor compaction (all files) 2023-03-19 14:55:12,766 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f8e8d7cf2c5e169edcb3b943f53497bc/family2 in testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:12,766 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2ef2f161f72b4885be16d467c2d07fee, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-f9050243921745d7a421f54a78279f75, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2452702cd07d48e5b34a29b501705fbd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9ab446dfd8214726af29869a4bc019f0] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp, totalSize=20.4 K 2023-03-19 14:55:12,766 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:12,767 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2ef2f161f72b4885be16d467c2d07fee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237687106 2023-03-19 14:55:12,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-f1eb51a16aea4f0da9b994008b59c96d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-f1eb51a16aea4f0da9b994008b59c96d 2023-03-19 14:55:12,771 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-f9050243921745d7a421f54a78279f75, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237688921 2023-03-19 14:55:12,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-eec30539054d4e3cae38aa42c55dc97e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family2/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-eec30539054d4e3cae38aa42c55dc97e 2023-03-19 14:55:12,772 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2452702cd07d48e5b34a29b501705fbd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237690763 2023-03-19 14:55:12,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-3135a14f577e414b895c137eda08f073, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9586c74f287d4c8ab2dd569cecbaff4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-22e271661cc847ccad251f5692d9f4cd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-68dadd12b3e742a187daf4580db38d31] to archive 2023-03-19 14:55:12,774 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] throttle.PressureAwareThroughputController(145): 9aa1fc0f1990ce625d14a4ce4d80764b#family1#compaction#118 average throughput is 0.47 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-19 14:55:12,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:12,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-3135a14f577e414b895c137eda08f073 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-3135a14f577e414b895c137eda08f073 2023-03-19 14:55:12,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9586c74f287d4c8ab2dd569cecbaff4a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9586c74f287d4c8ab2dd569cecbaff4a 2023-03-19 14:55:12,780 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9ab446dfd8214726af29869a4bc019f0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237692228 2023-03-19 14:55:12,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-22e271661cc847ccad251f5692d9f4cd to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-22e271661cc847ccad251f5692d9f4cd 2023-03-19 14:55:12,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-68dadd12b3e742a187daf4580db38d31 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family1/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-68dadd12b3e742a187daf4580db38d31 2023-03-19 14:55:12,782 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:12,783 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:12,792 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:12,793 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:12,805 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): f8e8d7cf2c5e169edcb3b943f53497bc#family2#compaction#119 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-19 14:55:12,819 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=276 (was 243) - Thread LEAK? -, OpenFileDescriptor=742 (was 607) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=156 (was 189), ProcessCount=168 (was 168), AvailableMemoryMB=4124 (was 4219) 2023-03-19 14:55:12,834 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=278, OpenFileDescriptor=740, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=168, AvailableMemoryMB=4123 2023-03-19 14:55:12,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-03-19 14:55:12,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-19 14:55:12,853 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-19 14:55:12,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-19 14:55:12,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 13 msec 2023-03-19 14:55:12,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-19 14:55:12,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-19 14:55:12,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-19 14:55:12,958 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:55:12,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-19 14:55:12,958 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:55:12,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-19 14:55:12,960 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:12,962 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:12,963 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:12,965 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6 empty. 2023-03-19 14:55:12,965 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24 empty. 2023-03-19 14:55:12,965 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a empty. 2023-03-19 14:55:12,965 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:12,966 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:12,969 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:12,969 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-19 14:55:13,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-19 14:55:13,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-19 14:55:13,399 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-19 14:55:13,402 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 87c27b1359899a7b93d3cb1ea602825a, NAME => 'ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:55:13,403 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => c07026313222798b71dcd0ce84d17a24, NAME => 'ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:55:13,403 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => bdb5c439f8ed2752db29e637c75284e6, NAME => 'ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:55:13,432 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:13,432 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:13,432 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing bdb5c439f8ed2752db29e637c75284e6, disabling compactions & flushes 2023-03-19 14:55:13,432 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:13,432 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:13,432 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing c07026313222798b71dcd0ce84d17a24, disabling compactions & flushes 2023-03-19 14:55:13,432 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. after waiting 0 ms 2023-03-19 14:55:13,432 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:13,432 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:13,433 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:13,433 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:13,433 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. after waiting 0 ms 2023-03-19 14:55:13,433 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:13,433 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:13,433 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:13,433 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:13,435 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:13,435 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 87c27b1359899a7b93d3cb1ea602825a, disabling compactions & flushes 2023-03-19 14:55:13,436 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:13,436 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:13,436 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. after waiting 0 ms 2023-03-19 14:55:13,436 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:13,436 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:13,436 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:13,439 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:55:13,440 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679237713440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237713440"}]},"ts":"1679237713440"} 2023-03-19 14:55:13,440 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679237713440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237713440"}]},"ts":"1679237713440"} 2023-03-19 14:55:13,440 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679237713440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237713440"}]},"ts":"1679237713440"} 2023-03-19 14:55:13,441 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-19 14:55:13,445 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:55:13,445 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237713445"}]},"ts":"1679237713445"} 2023-03-19 14:55:13,446 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-19 14:55:13,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bdb5c439f8ed2752db29e637c75284e6, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c07026313222798b71dcd0ce84d17a24, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=87c27b1359899a7b93d3cb1ea602825a, ASSIGN}] 2023-03-19 14:55:13,450 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c07026313222798b71dcd0ce84d17a24, ASSIGN 2023-03-19 14:55:13,450 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bdb5c439f8ed2752db29e637c75284e6, ASSIGN 2023-03-19 14:55:13,450 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=87c27b1359899a7b93d3cb1ea602825a, ASSIGN 2023-03-19 14:55:13,450 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bdb5c439f8ed2752db29e637c75284e6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:55:13,450 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c07026313222798b71dcd0ce84d17a24, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:55:13,451 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=87c27b1359899a7b93d3cb1ea602825a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:55:13,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-19 14:55:13,603 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=87c27b1359899a7b93d3cb1ea602825a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:13,603 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679237713603"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237713603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237713603"}]},"ts":"1679237713603"} 2023-03-19 14:55:13,603 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c07026313222798b71dcd0ce84d17a24, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:13,603 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bdb5c439f8ed2752db29e637c75284e6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:13,604 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679237713603"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237713603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237713603"}]},"ts":"1679237713603"} 2023-03-19 14:55:13,604 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679237713603"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237713603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237713603"}]},"ts":"1679237713603"} 2023-03-19 14:55:13,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 87c27b1359899a7b93d3cb1ea602825a, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:13,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure c07026313222798b71dcd0ce84d17a24, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:13,608 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure bdb5c439f8ed2752db29e637c75284e6, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:13,616 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/.tmp/family1/92edf38bfcbf4c20923e4c52731324e2 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/92edf38bfcbf4c20923e4c52731324e2 2023-03-19 14:55:13,620 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 9aa1fc0f1990ce625d14a4ce4d80764b/family1 of 9aa1fc0f1990ce625d14a4ce4d80764b into 92edf38bfcbf4c20923e4c52731324e2(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:13,620 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:55:13,620 INFO [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1679237712740; duration=0sec 2023-03-19 14:55:13,620 DEBUG [RS:0;jenkins-hbase20:33191-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:55:13,651 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/.tmp/family2/fd3f191496e247aeaa543a3c0126586e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/fd3f191496e247aeaa543a3c0126586e 2023-03-19 14:55:13,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-cc44908f6c5e427a90a6ca32334cf79e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-a498a7af9de5499eb5506fb088e5ce4b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-92eead09b38b4914801146ebd23ef20e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-6ef705ae3af44268957e31b013687a4a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/75b37be38cbd483e89962da78ab4bf04_SeqId_34_] to archive 2023-03-19 14:55:13,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:13,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-cc44908f6c5e427a90a6ca32334cf79e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-cc44908f6c5e427a90a6ca32334cf79e 2023-03-19 14:55:13,659 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f8e8d7cf2c5e169edcb3b943f53497bc/family2 of f8e8d7cf2c5e169edcb3b943f53497bc into fd3f191496e247aeaa543a3c0126586e(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:13,659 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:55:13,659 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc., storeName=f8e8d7cf2c5e169edcb3b943f53497bc/family2, priority=12, startTime=1679237711409; duration=0sec 2023-03-19 14:55:13,660 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:55:13,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-a498a7af9de5499eb5506fb088e5ce4b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-a498a7af9de5499eb5506fb088e5ce4b 2023-03-19 14:55:13,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-92eead09b38b4914801146ebd23ef20e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-92eead09b38b4914801146ebd23ef20e 2023-03-19 14:55:13,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-6ef705ae3af44268957e31b013687a4a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/testCompactionWithHFileLink=9aa1fc0f1990ce625d14a4ce4d80764b-6ef705ae3af44268957e31b013687a4a 2023-03-19 14:55:13,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/75b37be38cbd483e89962da78ab4bf04_SeqId_34_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/family1/75b37be38cbd483e89962da78ab4bf04_SeqId_34_ 2023-03-19 14:55:13,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2ef2f161f72b4885be16d467c2d07fee, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-f9050243921745d7a421f54a78279f75, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2452702cd07d48e5b34a29b501705fbd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9ab446dfd8214726af29869a4bc019f0] to archive 2023-03-19 14:55:13,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:13,675 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2ef2f161f72b4885be16d467c2d07fee to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2ef2f161f72b4885be16d467c2d07fee 2023-03-19 14:55:13,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-f9050243921745d7a421f54a78279f75 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-f9050243921745d7a421f54a78279f75 2023-03-19 14:55:13,681 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2452702cd07d48e5b34a29b501705fbd to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-2452702cd07d48e5b34a29b501705fbd 2023-03-19 14:55:13,682 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9ab446dfd8214726af29869a4bc019f0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/family2/testCompactionWithHFileLink=f8e8d7cf2c5e169edcb3b943f53497bc-9ab446dfd8214726af29869a4bc019f0 2023-03-19 14:55:13,697 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:55:13,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:13,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87c27b1359899a7b93d3cb1ea602825a, NAME => 'ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a.', STARTKEY => '2', ENDKEY => ''} 2023-03-19 14:55:13,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:13,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:13,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:13,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:13,762 INFO [StoreOpener-87c27b1359899a7b93d3cb1ea602825a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:13,765 DEBUG [StoreOpener-87c27b1359899a7b93d3cb1ea602825a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1 2023-03-19 14:55:13,765 DEBUG [StoreOpener-87c27b1359899a7b93d3cb1ea602825a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1 2023-03-19 14:55:13,765 INFO [StoreOpener-87c27b1359899a7b93d3cb1ea602825a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87c27b1359899a7b93d3cb1ea602825a columnFamilyName family1 2023-03-19 14:55:13,770 INFO [StoreOpener-87c27b1359899a7b93d3cb1ea602825a-1] regionserver.HStore(310): Store=87c27b1359899a7b93d3cb1ea602825a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:13,773 INFO [StoreOpener-87c27b1359899a7b93d3cb1ea602825a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:13,775 DEBUG [StoreOpener-87c27b1359899a7b93d3cb1ea602825a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2 2023-03-19 14:55:13,775 DEBUG [StoreOpener-87c27b1359899a7b93d3cb1ea602825a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2 2023-03-19 14:55:13,776 INFO [StoreOpener-87c27b1359899a7b93d3cb1ea602825a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87c27b1359899a7b93d3cb1ea602825a columnFamilyName family2 2023-03-19 14:55:13,778 INFO [StoreOpener-87c27b1359899a7b93d3cb1ea602825a-1] regionserver.HStore(310): Store=87c27b1359899a7b93d3cb1ea602825a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:13,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:13,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:13,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:55:13,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:13,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:55:13,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 87c27b1359899a7b93d3cb1ea602825a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67876023, jitterRate=0.011431559920310974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:55:13,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:13,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a., pid=109, masterSystemTime=1679237713756 2023-03-19 14:55:13,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:13,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:13,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:13,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bdb5c439f8ed2752db29e637c75284e6, NAME => 'ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6.', STARTKEY => '', ENDKEY => '1'} 2023-03-19 14:55:13,787 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=87c27b1359899a7b93d3cb1ea602825a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:13,787 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679237713787"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237713787"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237713787"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237713787"}]},"ts":"1679237713787"} 2023-03-19 14:55:13,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:13,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:13,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:13,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:13,789 INFO [StoreOpener-bdb5c439f8ed2752db29e637c75284e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:13,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-03-19 14:55:13,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 87c27b1359899a7b93d3cb1ea602825a, server=jenkins-hbase20.apache.org,33191,1679237584457 in 184 msec 2023-03-19 14:55:13,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=87c27b1359899a7b93d3cb1ea602825a, ASSIGN in 342 msec 2023-03-19 14:55:13,793 DEBUG [StoreOpener-bdb5c439f8ed2752db29e637c75284e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1 2023-03-19 14:55:13,793 DEBUG [StoreOpener-bdb5c439f8ed2752db29e637c75284e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1 2023-03-19 14:55:13,793 INFO [StoreOpener-bdb5c439f8ed2752db29e637c75284e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdb5c439f8ed2752db29e637c75284e6 columnFamilyName family1 2023-03-19 14:55:13,797 INFO [StoreOpener-bdb5c439f8ed2752db29e637c75284e6-1] regionserver.HStore(310): Store=bdb5c439f8ed2752db29e637c75284e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:13,797 INFO [StoreOpener-bdb5c439f8ed2752db29e637c75284e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:13,798 DEBUG [StoreOpener-bdb5c439f8ed2752db29e637c75284e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2 2023-03-19 14:55:13,798 DEBUG [StoreOpener-bdb5c439f8ed2752db29e637c75284e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2 2023-03-19 14:55:13,799 INFO [StoreOpener-bdb5c439f8ed2752db29e637c75284e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdb5c439f8ed2752db29e637c75284e6 columnFamilyName family2 2023-03-19 14:55:13,799 INFO [StoreOpener-bdb5c439f8ed2752db29e637c75284e6-1] regionserver.HStore(310): Store=bdb5c439f8ed2752db29e637c75284e6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:13,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:13,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:13,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:55:13,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:13,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:55:13,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bdb5c439f8ed2752db29e637c75284e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74888329, jitterRate=0.11592306196689606}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:55:13,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:13,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6., pid=111, masterSystemTime=1679237713756 2023-03-19 14:55:13,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:13,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:13,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:13,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c07026313222798b71dcd0ce84d17a24, NAME => 'ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24.', STARTKEY => '1', ENDKEY => '2'} 2023-03-19 14:55:13,811 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bdb5c439f8ed2752db29e637c75284e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:13,811 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1679237713811"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237713811"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237713811"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237713811"}]},"ts":"1679237713811"} 2023-03-19 14:55:13,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:13,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:13,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:13,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:13,813 INFO [StoreOpener-c07026313222798b71dcd0ce84d17a24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:13,814 DEBUG [StoreOpener-c07026313222798b71dcd0ce84d17a24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1 2023-03-19 14:55:13,814 DEBUG [StoreOpener-c07026313222798b71dcd0ce84d17a24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1 2023-03-19 14:55:13,814 INFO [StoreOpener-c07026313222798b71dcd0ce84d17a24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c07026313222798b71dcd0ce84d17a24 columnFamilyName family1 2023-03-19 14:55:13,815 INFO [StoreOpener-c07026313222798b71dcd0ce84d17a24-1] regionserver.HStore(310): Store=c07026313222798b71dcd0ce84d17a24/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:13,816 INFO [StoreOpener-c07026313222798b71dcd0ce84d17a24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:13,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=106 2023-03-19 14:55:13,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure bdb5c439f8ed2752db29e637c75284e6, server=jenkins-hbase20.apache.org,33191,1679237584457 in 206 msec 2023-03-19 14:55:13,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bdb5c439f8ed2752db29e637c75284e6, ASSIGN in 368 msec 2023-03-19 14:55:13,816 DEBUG [StoreOpener-c07026313222798b71dcd0ce84d17a24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2 2023-03-19 14:55:13,817 DEBUG [StoreOpener-c07026313222798b71dcd0ce84d17a24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2 2023-03-19 14:55:13,817 INFO [StoreOpener-c07026313222798b71dcd0ce84d17a24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c07026313222798b71dcd0ce84d17a24 columnFamilyName family2 2023-03-19 14:55:13,819 INFO [StoreOpener-c07026313222798b71dcd0ce84d17a24-1] regionserver.HStore(310): Store=c07026313222798b71dcd0ce84d17a24/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:13,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:13,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:13,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:55:13,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:13,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:55:13,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c07026313222798b71dcd0ce84d17a24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62754160, jitterRate=-0.06489014625549316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:55:13,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:13,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24., pid=110, masterSystemTime=1679237713756 2023-03-19 14:55:13,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c07026313222798b71dcd0ce84d17a24, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:13,830 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1679237713829"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237713829"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237713829"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237713829"}]},"ts":"1679237713829"} 2023-03-19 14:55:13,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:13,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:13,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=107 2023-03-19 14:55:13,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure c07026313222798b71dcd0ce84d17a24, server=jenkins-hbase20.apache.org,33191,1679237584457 in 224 msec 2023-03-19 14:55:13,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-03-19 14:55:13,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c07026313222798b71dcd0ce84d17a24, ASSIGN in 385 msec 2023-03-19 14:55:13,835 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:55:13,835 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237713835"}]},"ts":"1679237713835"} 2023-03-19 14:55:13,836 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-19 14:55:13,839 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:55:13,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 883 msec 2023-03-19 14:55:14,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-19 14:55:14,064 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-19 14:55:14,070 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:14,070 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:14,070 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:14,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:14,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-19 14:55:14,075 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-19 14:55:14,075 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:14,075 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-19 14:55:14,075 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-19 14:55:14,075 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:14,075 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:14,076 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:14,076 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:14,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:14,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:14,077 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:14,077 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:14,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:14,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:14,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:14,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-19 14:55:14,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-19 14:55:14,084 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-19 14:55:14,084 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:14,084 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-19 14:55:14,086 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:14,086 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. started... 2023-03-19 14:55:14,086 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:14,086 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. started... 2023-03-19 14:55:14,086 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:55:14,086 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:14,086 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:14,086 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. started... 2023-03-19 14:55:14,089 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 87c27b1359899a7b93d3cb1ea602825a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-19 14:55:14,089 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bdb5c439f8ed2752db29e637c75284e6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-19 14:55:14,089 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c07026313222798b71dcd0ce84d17a24 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-19 14:55:14,115 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319c075392907d1424eba0aa25d9fcaeab9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230319c075392907d1424eba0aa25d9fcaeab9 2023-03-19 14:55:14,115 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303190e53ad63ace04f228f9fa136fe8bde24 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303190e53ad63ace04f228f9fa136fe8bde24 2023-03-19 14:55:14,122 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303191f693b7750b04a6bac0ebf28d41395e9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303191f693b7750b04a6bac0ebf28d41395e9 2023-03-19 14:55:14,132 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/1531e4f87c8d4e3a9aa99f897476efef 2023-03-19 14:55:14,531 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/251792b5ce3f4b09aeb63172cce006ba 2023-03-19 14:55:14,536 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/27e16c3686204db090596ff0277c22b8 2023-03-19 14:55:14,556 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303198a106f81703b42b7bfbe0a37ace7d534 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303198a106f81703b42b7bfbe0a37ace7d534 2023-03-19 14:55:14,576 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319c030867dfc4946989d4bf63121e77cc6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230319c030867dfc4946989d4bf63121e77cc6 2023-03-19 14:55:14,578 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303194278a27c285248178abf068c45ade5e5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303194278a27c285248178abf068c45ade5e5 2023-03-19 14:55:14,973 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/7cf626da7f55405eb316860da2729f6a 2023-03-19 14:55:14,977 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/1531e4f87c8d4e3a9aa99f897476efef as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/1531e4f87c8d4e3a9aa99f897476efef 2023-03-19 14:55:14,982 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/1531e4f87c8d4e3a9aa99f897476efef, entries=4, sequenceid=5, filesize=5.4 K 2023-03-19 14:55:14,983 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/7cf626da7f55405eb316860da2729f6a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/7cf626da7f55405eb316860da2729f6a 2023-03-19 14:55:14,984 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/a027db9c0b63410abf656738f200a579 2023-03-19 14:55:14,986 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/3802e6162e844513aebddfc924649e43 2023-03-19 14:55:14,987 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/7cf626da7f55405eb316860da2729f6a, entries=2, sequenceid=5, filesize=5.1 K 2023-03-19 14:55:14,988 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c07026313222798b71dcd0ce84d17a24 in 899ms, sequenceid=5, compaction requested=false 2023-03-19 14:55:14,988 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-19 14:55:14,988 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/251792b5ce3f4b09aeb63172cce006ba as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/251792b5ce3f4b09aeb63172cce006ba 2023-03-19 14:55:14,989 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:14,989 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:14,989 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:55:14,990 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/27e16c3686204db090596ff0277c22b8 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/27e16c3686204db090596ff0277c22b8 2023-03-19 14:55:14,992 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/251792b5ce3f4b09aeb63172cce006ba, entries=4, sequenceid=5, filesize=5.4 K 2023-03-19 14:55:14,993 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/a027db9c0b63410abf656738f200a579 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/a027db9c0b63410abf656738f200a579 2023-03-19 14:55:14,993 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/27e16c3686204db090596ff0277c22b8, entries=4, sequenceid=5, filesize=5.4 K 2023-03-19 14:55:14,994 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/3802e6162e844513aebddfc924649e43 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3802e6162e844513aebddfc924649e43 2023-03-19 14:55:14,996 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/a027db9c0b63410abf656738f200a579, entries=2, sequenceid=5, filesize=5.1 K 2023-03-19 14:55:14,996 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3802e6162e844513aebddfc924649e43, entries=2, sequenceid=5, filesize=5.1 K 2023-03-19 14:55:14,997 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 87c27b1359899a7b93d3cb1ea602825a in 908ms, sequenceid=5, compaction requested=false 2023-03-19 14:55:14,997 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:14,997 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bdb5c439f8ed2752db29e637c75284e6 in 908ms, sequenceid=5, compaction requested=false 2023-03-19 14:55:14,997 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:14,997 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:14,998 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:55:14,998 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:14,998 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:55:14,998 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:55:14,998 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:14,998 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-19 14:55:14,998 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-19 14:55:14,999 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:14,999 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:14,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:14,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:14,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:14,999 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:14,999 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:14,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:14,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:14,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:15,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:15,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-19 14:55:15,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3abe3322[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:15,000 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-19 14:55:15,000 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:15,001 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:15,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:15,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:15,001 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-19 14:55:15,001 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-19 14:55:15,001 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:15,001 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,001 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:15,001 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-19 14:55:15,001 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,002 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:15,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:15,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:15,002 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-19 14:55:15,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:15,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:15,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:15,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:15,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-19 14:55:15,004 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-19 14:55:15,004 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:15,004 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:15,004 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-19 14:55:15,004 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:15,005 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:15,005 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:15,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:15,005 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:15,006 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:15,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:15,007 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:15,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:15,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,008 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,008 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:15,008 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:15,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:15,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:15,008 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:15,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-19 14:55:15,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-19 14:55:15,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:15,008 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:15,008 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:15,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:15,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:15,009 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,009 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:15,009 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:15,009 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:15,009 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:15,009 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:15,109 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:15,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:15,111 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:15,111 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:15,111 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:15,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:15,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:15,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-19 14:55:15,115 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-19 14:55:15,115 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:15,115 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-19 14:55:15,116 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-19 14:55:15,116 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:15,116 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:15,117 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:15,117 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:15,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:15,117 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:15,117 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:15,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:15,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:15,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:15,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:15,119 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-19 14:55:15,119 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-19 14:55:15,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-19 14:55:15,120 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-19 14:55:15,120 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:15,120 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-19 14:55:15,120 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:15,120 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:15,120 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:55:15,120 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:15,120 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. started... 2023-03-19 14:55:15,120 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. started... 2023-03-19 14:55:15,120 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:15,120 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. started... 2023-03-19 14:55:15,120 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c07026313222798b71dcd0ce84d17a24 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-19 14:55:15,120 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bdb5c439f8ed2752db29e637c75284e6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-19 14:55:15,120 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 87c27b1359899a7b93d3cb1ea602825a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-19 14:55:15,166 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303198c52f78aedd54949afe3fe69247ecea4 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303198c52f78aedd54949afe3fe69247ecea4 2023-03-19 14:55:15,167 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319fd6aeb949adf4819bf8f65806c81bf51 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230319fd6aeb949adf4819bf8f65806c81bf51 2023-03-19 14:55:15,181 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/b3d5196e73ea4bc7b348755ad4c78841 2023-03-19 14:55:15,185 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/e785c40bf5c141678969001400023a5b 2023-03-19 14:55:15,220 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319db2c5a717adf4952a9930e187d7be711 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230319db2c5a717adf4952a9930e187d7be711 2023-03-19 14:55:15,557 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319ecde7524dfac479aa622f8123df129fc to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230319ecde7524dfac479aa622f8123df129fc 2023-03-19 14:55:15,621 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319af2819d562b040018ca2c09dacbf9546 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230319af2819d562b040018ca2c09dacbf9546 2023-03-19 14:55:15,626 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/31da6e4e37dd4271bda37e352b57e4ee 2023-03-19 14:55:15,627 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/147b268442fe48dc9658f1932eef44d6 2023-03-19 14:55:15,631 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/e785c40bf5c141678969001400023a5b as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/e785c40bf5c141678969001400023a5b 2023-03-19 14:55:15,631 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/b3d5196e73ea4bc7b348755ad4c78841 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/b3d5196e73ea4bc7b348755ad4c78841 2023-03-19 14:55:15,633 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/e785c40bf5c141678969001400023a5b, entries=4, sequenceid=9, filesize=5.4 K 2023-03-19 14:55:15,633 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/b3d5196e73ea4bc7b348755ad4c78841, entries=4, sequenceid=9, filesize=5.4 K 2023-03-19 14:55:15,634 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/147b268442fe48dc9658f1932eef44d6 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/147b268442fe48dc9658f1932eef44d6 2023-03-19 14:55:15,636 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/31da6e4e37dd4271bda37e352b57e4ee as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/31da6e4e37dd4271bda37e352b57e4ee 2023-03-19 14:55:15,638 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/147b268442fe48dc9658f1932eef44d6, entries=2, sequenceid=9, filesize=5.1 K 2023-03-19 14:55:15,640 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/31da6e4e37dd4271bda37e352b57e4ee, entries=2, sequenceid=9, filesize=5.1 K 2023-03-19 14:55:15,640 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c07026313222798b71dcd0ce84d17a24 in 520ms, sequenceid=9, compaction requested=false 2023-03-19 14:55:15,640 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bdb5c439f8ed2752db29e637c75284e6 in 520ms, sequenceid=9, compaction requested=false 2023-03-19 14:55:15,641 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:15,641 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:15,641 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:15,641 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:15,641 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:55:15,641 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:55:15,963 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/17955f70f13c44378d5df66d42d04461 2023-03-19 14:55:16,386 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303197b76b9c8e2764fcaa84029797a7b0d76 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303197b76b9c8e2764fcaa84029797a7b0d76 2023-03-19 14:55:16,393 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/f079dcbe54904f279c91accb12a60bd8 2023-03-19 14:55:16,397 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/17955f70f13c44378d5df66d42d04461 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/17955f70f13c44378d5df66d42d04461 2023-03-19 14:55:16,401 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/17955f70f13c44378d5df66d42d04461, entries=4, sequenceid=9, filesize=5.4 K 2023-03-19 14:55:16,402 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/f079dcbe54904f279c91accb12a60bd8 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f079dcbe54904f279c91accb12a60bd8 2023-03-19 14:55:16,405 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f079dcbe54904f279c91accb12a60bd8, entries=2, sequenceid=9, filesize=5.1 K 2023-03-19 14:55:16,406 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 87c27b1359899a7b93d3cb1ea602825a in 1286ms, sequenceid=9, compaction requested=false 2023-03-19 14:55:16,406 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:16,406 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:16,406 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:55:16,406 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:55:16,407 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,407 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-19 14:55:16,407 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-19 14:55:16,408 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,408 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:16,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:16,409 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:16,409 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:16,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-19 14:55:16,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76d2c62c[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:16,410 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-19 14:55:16,410 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:16,411 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:16,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:16,411 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-19 14:55:16,411 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-19 14:55:16,411 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:16,411 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,411 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:16,412 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-19 14:55:16,412 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:16,412 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:16,412 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-19 14:55:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:16,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-19 14:55:16,415 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-19 14:55:16,415 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:16,415 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:16,415 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-19 14:55:16,415 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:16,416 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:16,416 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:16,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:16,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:16,416 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:16,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:16,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:16,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:16,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:16,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:16,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:16,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:16,420 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:16,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:16,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:16,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,421 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:16,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:16,423 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:16,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-19 14:55:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:16,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:16,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:16,423 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:16,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:16,524 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:16,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:16,526 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:16,526 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:16,526 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:16,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:16,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:16,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-19 14:55:16,530 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-19 14:55:16,530 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:16,530 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-19 14:55:16,530 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-19 14:55:16,531 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:16,531 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:16,531 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,531 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:16,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:16,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:16,532 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:16,532 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:16,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:16,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:16,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:16,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:16,532 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-19 14:55:16,532 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-19 14:55:16,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-19 14:55:16,533 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-19 14:55:16,533 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:16,533 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-19 14:55:16,533 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:16,533 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. started... 2023-03-19 14:55:16,533 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:16,533 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. started... 2023-03-19 14:55:16,533 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c07026313222798b71dcd0ce84d17a24 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-19 14:55:16,533 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 87c27b1359899a7b93d3cb1ea602825a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-19 14:55:16,533 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:55:16,533 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:16,533 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:16,533 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. started... 2023-03-19 14:55:16,533 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bdb5c439f8ed2752db29e637c75284e6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-19 14:55:16,544 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031942d01a2e2c354994ae9be716db59929d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023031942d01a2e2c354994ae9be716db59929d 2023-03-19 14:55:16,950 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/496d6285a3024cd9828b2ce616711a33 2023-03-19 14:55:16,952 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319128b384b5d9d42febb2dee45bed304b6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230319128b384b5d9d42febb2dee45bed304b6 2023-03-19 14:55:16,953 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031926dc0c5a3a2e4bd0b3890c3cc62bb254 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023031926dc0c5a3a2e4bd0b3890c3cc62bb254 2023-03-19 14:55:16,959 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/f11862700e87492eaff20912cffbcaa7 2023-03-19 14:55:17,361 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/2746fa654ec44e6aaec745b9928a523c 2023-03-19 14:55:17,372 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319dedc9c565fa2464e9fd764885216246c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230319dedc9c565fa2464e9fd764885216246c 2023-03-19 14:55:17,374 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319f4248c9931e9443299478f8ab01cb104 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230319f4248c9931e9443299478f8ab01cb104 2023-03-19 14:55:17,383 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/c907e3225fe34937a09b7ffd3d6fee72 2023-03-19 14:55:17,387 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/f11862700e87492eaff20912cffbcaa7 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/f11862700e87492eaff20912cffbcaa7 2023-03-19 14:55:17,389 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/f11862700e87492eaff20912cffbcaa7, entries=4, sequenceid=13, filesize=5.4 K 2023-03-19 14:55:17,390 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/c907e3225fe34937a09b7ffd3d6fee72 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/c907e3225fe34937a09b7ffd3d6fee72 2023-03-19 14:55:17,393 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/c907e3225fe34937a09b7ffd3d6fee72, entries=2, sequenceid=13, filesize=5.1 K 2023-03-19 14:55:17,393 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c07026313222798b71dcd0ce84d17a24 in 860ms, sequenceid=13, compaction requested=true 2023-03-19 14:55:17,393 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:17,393 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:17,393 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:55:17,784 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/27e9860883f345a498fed03352deb5e2 2023-03-19 14:55:17,794 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319d1b5515fd41a4289a9eb7845702f809c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230319d1b5515fd41a4289a9eb7845702f809c 2023-03-19 14:55:17,795 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/496d6285a3024cd9828b2ce616711a33 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/496d6285a3024cd9828b2ce616711a33 2023-03-19 14:55:17,799 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/109c873c97dd430490e28aa963f1afac 2023-03-19 14:55:17,799 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/496d6285a3024cd9828b2ce616711a33, entries=4, sequenceid=13, filesize=5.4 K 2023-03-19 14:55:17,800 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/27e9860883f345a498fed03352deb5e2 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/27e9860883f345a498fed03352deb5e2 2023-03-19 14:55:17,803 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/2746fa654ec44e6aaec745b9928a523c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/2746fa654ec44e6aaec745b9928a523c 2023-03-19 14:55:17,804 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/27e9860883f345a498fed03352deb5e2, entries=2, sequenceid=13, filesize=5.1 K 2023-03-19 14:55:17,805 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 87c27b1359899a7b93d3cb1ea602825a in 1272ms, sequenceid=13, compaction requested=true 2023-03-19 14:55:17,805 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:17,805 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:17,805 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:55:17,807 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/2746fa654ec44e6aaec745b9928a523c, entries=4, sequenceid=13, filesize=5.4 K 2023-03-19 14:55:17,808 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/109c873c97dd430490e28aa963f1afac as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/109c873c97dd430490e28aa963f1afac 2023-03-19 14:55:17,813 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/109c873c97dd430490e28aa963f1afac, entries=2, sequenceid=13, filesize=5.1 K 2023-03-19 14:55:17,813 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bdb5c439f8ed2752db29e637c75284e6 in 1280ms, sequenceid=13, compaction requested=true 2023-03-19 14:55:17,813 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:17,813 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:17,813 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:55:17,814 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:55:17,814 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,814 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-19 14:55:17,814 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-19 14:55:17,815 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:17,815 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:17,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:17,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:17,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:17,815 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:17,816 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:17,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:17,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:17,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-19 14:55:17,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b7d98cc[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:17,816 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-19 14:55:17,817 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:17,817 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:17,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:17,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:17,817 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-19 14:55:17,817 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-19 14:55:17,817 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:17,817 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,817 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:17,818 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-19 14:55:17,818 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,818 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:17,818 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-19 14:55:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:17,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-19 14:55:17,820 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-19 14:55:17,820 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:17,820 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:17,820 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-19 14:55:17,820 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:17,821 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:17,821 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:17,821 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:17,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:17,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:17,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:17,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:17,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:17,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:17,822 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:17,822 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:17,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:17,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:17,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:17,824 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:17,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-19 14:55:17,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:17,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-19 14:55:17,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:17,824 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:17,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:17,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:17,924 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:17,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:17,926 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:17,926 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:17,926 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:17,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:17,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:17,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-19 14:55:17,931 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-19 14:55:17,932 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:17,932 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-19 14:55:17,932 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-19 14:55:17,932 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:17,932 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:17,933 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:17,933 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:17,934 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:17,934 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:17,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:17,935 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-19 14:55:17,936 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-19 14:55:17,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-19 14:55:17,936 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-19 14:55:17,936 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:17,936 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-19 14:55:17,936 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:17,936 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. started... 2023-03-19 14:55:17,936 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:17,937 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. started... 2023-03-19 14:55:17,937 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c07026313222798b71dcd0ce84d17a24 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-19 14:55:17,936 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:55:17,937 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:17,937 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 87c27b1359899a7b93d3cb1ea602825a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-19 14:55:17,937 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:17,937 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. started... 2023-03-19 14:55:17,937 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bdb5c439f8ed2752db29e637c75284e6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-19 14:55:17,949 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319785deae05ce54adabe275e48c3cb17d9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230319785deae05ce54adabe275e48c3cb17d9 2023-03-19 14:55:18,353 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/7b9f596f22c74ee9a71cc74830dd83ea 2023-03-19 14:55:18,355 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303190ce4aa02d49d48af8653189e33f75498 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303190ce4aa02d49d48af8653189e33f75498 2023-03-19 14:55:18,355 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319952b0e979c3d4c7cb9d284777439502c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230319952b0e979c3d4c7cb9d284777439502c 2023-03-19 14:55:18,765 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/6569e6ab3a1740979da032ec4dc8bb2e 2023-03-19 14:55:18,765 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/45373520245d40029238129d8a83f350 2023-03-19 14:55:18,773 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319de14b3f6383f4f61a84f485544cabf52 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230319de14b3f6383f4f61a84f485544cabf52 2023-03-19 14:55:19,181 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/3651397558414aa485d1cb294d8afea8 2023-03-19 14:55:19,190 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319d6f5dd378fc34812825595ce5e52cca5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230319d6f5dd378fc34812825595ce5e52cca5 2023-03-19 14:55:19,191 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/7b9f596f22c74ee9a71cc74830dd83ea as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/7b9f596f22c74ee9a71cc74830dd83ea 2023-03-19 14:55:19,193 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319ab2388805def4fdabbf168361fd7d4a1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230319ab2388805def4fdabbf168361fd7d4a1 2023-03-19 14:55:19,196 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/7b9f596f22c74ee9a71cc74830dd83ea, entries=4, sequenceid=17, filesize=5.4 K 2023-03-19 14:55:19,197 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/3651397558414aa485d1cb294d8afea8 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3651397558414aa485d1cb294d8afea8 2023-03-19 14:55:19,200 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/f89572fa317a4457914c3071fab047ec 2023-03-19 14:55:19,201 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3651397558414aa485d1cb294d8afea8, entries=2, sequenceid=17, filesize=5.1 K 2023-03-19 14:55:19,201 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bdb5c439f8ed2752db29e637c75284e6 in 1264ms, sequenceid=17, compaction requested=true 2023-03-19 14:55:19,201 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:19,201 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:19,201 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:55:19,203 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/45373520245d40029238129d8a83f350 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/45373520245d40029238129d8a83f350 2023-03-19 14:55:19,206 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/45373520245d40029238129d8a83f350, entries=4, sequenceid=17, filesize=5.4 K 2023-03-19 14:55:19,206 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/f89572fa317a4457914c3071fab047ec as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f89572fa317a4457914c3071fab047ec 2023-03-19 14:55:19,209 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f89572fa317a4457914c3071fab047ec, entries=2, sequenceid=17, filesize=5.1 K 2023-03-19 14:55:19,210 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 87c27b1359899a7b93d3cb1ea602825a in 1273ms, sequenceid=17, compaction requested=true 2023-03-19 14:55:19,210 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:19,210 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:19,210 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:55:19,263 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:55:19,598 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/65d6f494ecd646c3828b5750140e922a 2023-03-19 14:55:19,612 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/6569e6ab3a1740979da032ec4dc8bb2e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/6569e6ab3a1740979da032ec4dc8bb2e 2023-03-19 14:55:19,617 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/6569e6ab3a1740979da032ec4dc8bb2e, entries=4, sequenceid=17, filesize=5.4 K 2023-03-19 14:55:19,618 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/65d6f494ecd646c3828b5750140e922a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/65d6f494ecd646c3828b5750140e922a 2023-03-19 14:55:19,623 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/65d6f494ecd646c3828b5750140e922a, entries=2, sequenceid=17, filesize=5.1 K 2023-03-19 14:55:19,623 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c07026313222798b71dcd0ce84d17a24 in 1686ms, sequenceid=17, compaction requested=true 2023-03-19 14:55:19,624 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:19,624 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:19,624 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:55:19,624 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:55:19,624 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,624 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-19 14:55:19,624 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-19 14:55:19,625 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,625 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:19,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:19,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:19,626 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:19,626 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:19,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:19,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:19,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:19,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:19,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-19 14:55:19,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e9284b[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:19,628 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-19 14:55:19,628 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:19,628 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:19,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:19,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:19,629 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-19 14:55:19,629 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,629 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:19,629 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-19 14:55:19,629 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:19,630 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-19 14:55:19,630 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:19,630 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,630 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-19 14:55:19,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:19,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:19,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:19,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:19,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:19,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-19 14:55:19,633 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-19 14:55:19,633 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:19,633 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:19,633 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-19 14:55:19,633 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:19,635 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:19,635 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:19,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:19,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:19,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:19,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:19,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:19,635 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:19,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:19,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:19,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:19,636 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:19,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:19,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:19,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:19,637 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:19,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,640 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:19,640 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:19,640 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:19,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:19,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-19 14:55:19,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:19,640 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:19,640 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:19,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:19,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:19,641 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:19,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-19 14:55:19,641 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,641 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:19,641 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:19,641 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:19,641 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:19,641 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:19,741 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:19,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:19,752 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:19,761 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:19,767 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:19,768 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:19,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:19,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:19,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-19 14:55:19,796 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-19 14:55:19,796 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:19,796 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-19 14:55:19,796 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-19 14:55:19,797 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:19,797 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:19,797 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:19,797 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:19,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:19,798 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:19,798 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:19,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:19,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:19,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:19,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:19,798 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-19 14:55:19,798 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-19 14:55:19,798 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-19 14:55:19,798 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-19 14:55:19,798 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:19,798 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-19 14:55:19,799 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:19,799 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. started... 2023-03-19 14:55:19,799 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:55:19,799 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:19,799 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:19,799 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. started... 2023-03-19 14:55:19,799 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c07026313222798b71dcd0ce84d17a24 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-19 14:55:19,799 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing bdb5c439f8ed2752db29e637c75284e6 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-19 14:55:19,799 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:19,799 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. started... 2023-03-19 14:55:19,799 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 87c27b1359899a7b93d3cb1ea602825a 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-19 14:55:20,216 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/f348f0e4f15b4d32b49eefe387abfcf5 2023-03-19 14:55:20,219 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f348f0e4f15b4d32b49eefe387abfcf5 2023-03-19 14:55:20,614 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/ceeea4028ae443f2a7f4b06d91f9f4e0 2023-03-19 14:55:20,615 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/d31b6b8fb65247ac8ff5f218fff1342f 2023-03-19 14:55:20,618 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ceeea4028ae443f2a7f4b06d91f9f4e0 2023-03-19 14:55:20,618 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d31b6b8fb65247ac8ff5f218fff1342f 2023-03-19 14:55:21,028 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/4f97a2b6da524df4ab3456ba0bd38963 2023-03-19 14:55:21,031 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f97a2b6da524df4ab3456ba0bd38963 2023-03-19 14:55:21,031 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/f348f0e4f15b4d32b49eefe387abfcf5 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/f348f0e4f15b4d32b49eefe387abfcf5 2023-03-19 14:55:21,034 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f348f0e4f15b4d32b49eefe387abfcf5 2023-03-19 14:55:21,034 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/f348f0e4f15b4d32b49eefe387abfcf5, entries=3, sequenceid=23, filesize=5.0 K 2023-03-19 14:55:21,035 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/4f97a2b6da524df4ab3456ba0bd38963 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/4f97a2b6da524df4ab3456ba0bd38963 2023-03-19 14:55:21,037 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f97a2b6da524df4ab3456ba0bd38963 2023-03-19 14:55:21,038 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/4f97a2b6da524df4ab3456ba0bd38963, entries=1, sequenceid=23, filesize=5.0 K 2023-03-19 14:55:21,038 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bdb5c439f8ed2752db29e637c75284e6 in 1239ms, sequenceid=23, compaction requested=true 2023-03-19 14:55:21,038 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:21,038 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:21,038 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:55:21,429 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/eabc6d33a9c949399063569fbc79acc6 2023-03-19 14:55:21,429 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/f0f9cb4d4db343c2bcdaa0e9f21e0968 2023-03-19 14:55:21,432 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0f9cb4d4db343c2bcdaa0e9f21e0968 2023-03-19 14:55:21,432 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eabc6d33a9c949399063569fbc79acc6 2023-03-19 14:55:21,433 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/d31b6b8fb65247ac8ff5f218fff1342f as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d31b6b8fb65247ac8ff5f218fff1342f 2023-03-19 14:55:21,433 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/ceeea4028ae443f2a7f4b06d91f9f4e0 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/ceeea4028ae443f2a7f4b06d91f9f4e0 2023-03-19 14:55:21,436 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d31b6b8fb65247ac8ff5f218fff1342f 2023-03-19 14:55:21,436 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ceeea4028ae443f2a7f4b06d91f9f4e0 2023-03-19 14:55:21,436 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d31b6b8fb65247ac8ff5f218fff1342f, entries=3, sequenceid=23, filesize=5.0 K 2023-03-19 14:55:21,436 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/ceeea4028ae443f2a7f4b06d91f9f4e0, entries=3, sequenceid=23, filesize=5.0 K 2023-03-19 14:55:21,437 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/f0f9cb4d4db343c2bcdaa0e9f21e0968 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f0f9cb4d4db343c2bcdaa0e9f21e0968 2023-03-19 14:55:21,437 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/eabc6d33a9c949399063569fbc79acc6 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/eabc6d33a9c949399063569fbc79acc6 2023-03-19 14:55:21,440 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0f9cb4d4db343c2bcdaa0e9f21e0968 2023-03-19 14:55:21,440 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eabc6d33a9c949399063569fbc79acc6 2023-03-19 14:55:21,440 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f0f9cb4d4db343c2bcdaa0e9f21e0968, entries=1, sequenceid=23, filesize=5.0 K 2023-03-19 14:55:21,440 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/eabc6d33a9c949399063569fbc79acc6, entries=1, sequenceid=23, filesize=5.0 K 2023-03-19 14:55:21,441 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c07026313222798b71dcd0ce84d17a24 in 1642ms, sequenceid=23, compaction requested=true 2023-03-19 14:55:21,441 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 87c27b1359899a7b93d3cb1ea602825a in 1642ms, sequenceid=23, compaction requested=true 2023-03-19 14:55:21,441 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:21,441 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:21,441 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:21,441 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:21,441 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:55:21,441 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:55:21,441 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:55:21,441 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,441 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-19 14:55:21,441 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-19 14:55:21,442 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,442 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:21,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:21,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:21,442 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:21,442 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:21,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-19 14:55:21,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d853697[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:21,443 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-19 14:55:21,444 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:21,444 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:21,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:21,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-19 14:55:21,445 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,445 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-19 14:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:21,445 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-19 14:55:21,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:21,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:21,445 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:21,446 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-19 14:55:21,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:21,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:21,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:21,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:21,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-19 14:55:21,447 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-19 14:55:21,447 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:21,447 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:21,447 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-19 14:55:21,447 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:21,448 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:21,448 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:21,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:21,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:21,448 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:21,449 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:21,449 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-19 14:55:21,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-19 14:55:21,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-19 14:55:21,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:21,451 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:21,451 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:21,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:21,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:21,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:21,451 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-19 14:55:21,551 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:21,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:21,552 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:21,553 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): c07026313222798b71dcd0ce84d17a24/family1 is initiating major compaction (all files) 2023-03-19 14:55:21,553 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:21,553 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:21,553 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of c07026313222798b71dcd0ce84d17a24/family1 in ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:21,553 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/1531e4f87c8d4e3a9aa99f897476efef, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/e785c40bf5c141678969001400023a5b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/f11862700e87492eaff20912cffbcaa7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/6569e6ab3a1740979da032ec4dc8bb2e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/ceeea4028ae443f2a7f4b06d91f9f4e0] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp, totalSize=26.6 K 2023-03-19 14:55:21,553 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 1531e4f87c8d4e3a9aa99f897476efef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237714070 2023-03-19 14:55:21,554 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting e785c40bf5c141678969001400023a5b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237715111 2023-03-19 14:55:21,554 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting f11862700e87492eaff20912cffbcaa7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237716526 2023-03-19 14:55:21,555 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 6569e6ab3a1740979da032ec4dc8bb2e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237717926 2023-03-19 14:55:21,555 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting ceeea4028ae443f2a7f4b06d91f9f4e0, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:21,563 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): c07026313222798b71dcd0ce84d17a24#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:21,970 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230319561ec584d2f646539f1aa3aedc1f19b1_del 2023-03-19 14:55:21,970 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319561ec584d2f646539f1aa3aedc1f19b1_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230319561ec584d2f646539f1aa3aedc1f19b1_del 2023-03-19 14:55:22,797 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1567d43797d400baa4c644f31d94544 2023-03-19 14:55:22,799 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family1/b1567d43797d400baa4c644f31d94544 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/b1567d43797d400baa4c644f31d94544 2023-03-19 14:55:22,805 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b1567d43797d400baa4c644f31d94544 2023-03-19 14:55:22,806 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c07026313222798b71dcd0ce84d17a24/family1 of c07026313222798b71dcd0ce84d17a24 into b1567d43797d400baa4c644f31d94544(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:22,806 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:22,806 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:22,806 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): c07026313222798b71dcd0ce84d17a24/family2 is initiating major compaction (all files) 2023-03-19 14:55:22,806 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:22,806 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:22,807 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of c07026313222798b71dcd0ce84d17a24/family2 in ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:22,807 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/7cf626da7f55405eb316860da2729f6a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/31da6e4e37dd4271bda37e352b57e4ee, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/c907e3225fe34937a09b7ffd3d6fee72, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/65d6f494ecd646c3828b5750140e922a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/eabc6d33a9c949399063569fbc79acc6] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp, totalSize=25.3 K 2023-03-19 14:55:22,807 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 7cf626da7f55405eb316860da2729f6a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237714070 2023-03-19 14:55:22,808 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 31da6e4e37dd4271bda37e352b57e4ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237715111 2023-03-19 14:55:22,808 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting c907e3225fe34937a09b7ffd3d6fee72, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237716526 2023-03-19 14:55:22,808 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 65d6f494ecd646c3828b5750140e922a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237717926 2023-03-19 14:55:22,809 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting eabc6d33a9c949399063569fbc79acc6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:22,820 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): c07026313222798b71dcd0ce84d17a24#family2#compaction#151 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:22,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/1531e4f87c8d4e3a9aa99f897476efef, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/e785c40bf5c141678969001400023a5b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/f11862700e87492eaff20912cffbcaa7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/6569e6ab3a1740979da032ec4dc8bb2e, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/ceeea4028ae443f2a7f4b06d91f9f4e0] to archive 2023-03-19 14:55:22,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:22,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/1531e4f87c8d4e3a9aa99f897476efef to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/1531e4f87c8d4e3a9aa99f897476efef 2023-03-19 14:55:22,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/e785c40bf5c141678969001400023a5b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/e785c40bf5c141678969001400023a5b 2023-03-19 14:55:22,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/f11862700e87492eaff20912cffbcaa7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/f11862700e87492eaff20912cffbcaa7 2023-03-19 14:55:22,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/6569e6ab3a1740979da032ec4dc8bb2e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/6569e6ab3a1740979da032ec4dc8bb2e 2023-03-19 14:55:22,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/ceeea4028ae443f2a7f4b06d91f9f4e0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/ceeea4028ae443f2a7f4b06d91f9f4e0 2023-03-19 14:55:23,241 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230319a3c582804ffb4da7b71cf855cca0958d_del 2023-03-19 14:55:23,241 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319a3c582804ffb4da7b71cf855cca0958d_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230319a3c582804ffb4da7b71cf855cca0958d_del 2023-03-19 14:55:24,071 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1d9be30a64a46b99797ba8d7c687291 2023-03-19 14:55:24,073 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/.tmp/family2/f1d9be30a64a46b99797ba8d7c687291 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/f1d9be30a64a46b99797ba8d7c687291 2023-03-19 14:55:24,078 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1d9be30a64a46b99797ba8d7c687291 2023-03-19 14:55:24,079 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c07026313222798b71dcd0ce84d17a24/family2 of c07026313222798b71dcd0ce84d17a24 into f1d9be30a64a46b99797ba8d7c687291(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:24,080 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:24,080 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:24,080 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): 87c27b1359899a7b93d3cb1ea602825a/family1 is initiating major compaction (all files) 2023-03-19 14:55:24,080 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:24,080 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:24,080 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of 87c27b1359899a7b93d3cb1ea602825a/family1 in ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:24,080 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/251792b5ce3f4b09aeb63172cce006ba, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/17955f70f13c44378d5df66d42d04461, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/496d6285a3024cd9828b2ce616711a33, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/45373520245d40029238129d8a83f350, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d31b6b8fb65247ac8ff5f218fff1342f] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp, totalSize=26.6 K 2023-03-19 14:55:24,081 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 251792b5ce3f4b09aeb63172cce006ba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237714070 2023-03-19 14:55:24,082 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 17955f70f13c44378d5df66d42d04461, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237715111 2023-03-19 14:55:24,082 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 496d6285a3024cd9828b2ce616711a33, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237716526 2023-03-19 14:55:24,083 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 45373520245d40029238129d8a83f350, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237717926 2023-03-19 14:55:24,083 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting d31b6b8fb65247ac8ff5f218fff1342f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:24,093 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): 87c27b1359899a7b93d3cb1ea602825a#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:24,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/7cf626da7f55405eb316860da2729f6a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/31da6e4e37dd4271bda37e352b57e4ee, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/c907e3225fe34937a09b7ffd3d6fee72, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/65d6f494ecd646c3828b5750140e922a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/eabc6d33a9c949399063569fbc79acc6] to archive 2023-03-19 14:55:24,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:24,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/7cf626da7f55405eb316860da2729f6a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/7cf626da7f55405eb316860da2729f6a 2023-03-19 14:55:24,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/31da6e4e37dd4271bda37e352b57e4ee to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/31da6e4e37dd4271bda37e352b57e4ee 2023-03-19 14:55:24,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/c907e3225fe34937a09b7ffd3d6fee72 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/c907e3225fe34937a09b7ffd3d6fee72 2023-03-19 14:55:24,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/65d6f494ecd646c3828b5750140e922a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/65d6f494ecd646c3828b5750140e922a 2023-03-19 14:55:24,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/eabc6d33a9c949399063569fbc79acc6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family2/eabc6d33a9c949399063569fbc79acc6 2023-03-19 14:55:24,508 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023031951c3a555de4a4ef99a4a581de4f16a51_del 2023-03-19 14:55:24,508 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031951c3a555de4a4ef99a4a581de4f16a51_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023031951c3a555de4a4ef99a4a581de4f16a51_del 2023-03-19 14:55:25,339 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2dda0970563478792aa13ff59773a02 2023-03-19 14:55:25,340 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family1/d2dda0970563478792aa13ff59773a02 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d2dda0970563478792aa13ff59773a02 2023-03-19 14:55:25,344 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2dda0970563478792aa13ff59773a02 2023-03-19 14:55:25,345 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 87c27b1359899a7b93d3cb1ea602825a/family1 of 87c27b1359899a7b93d3cb1ea602825a into d2dda0970563478792aa13ff59773a02(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:25,345 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:25,345 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:25,345 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): 87c27b1359899a7b93d3cb1ea602825a/family2 is initiating major compaction (all files) 2023-03-19 14:55:25,346 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:25,346 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:25,346 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of 87c27b1359899a7b93d3cb1ea602825a/family2 in ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:25,346 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/a027db9c0b63410abf656738f200a579, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f079dcbe54904f279c91accb12a60bd8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/27e9860883f345a498fed03352deb5e2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f89572fa317a4457914c3071fab047ec, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f0f9cb4d4db343c2bcdaa0e9f21e0968] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp, totalSize=25.3 K 2023-03-19 14:55:25,346 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting a027db9c0b63410abf656738f200a579, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237714070 2023-03-19 14:55:25,347 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting f079dcbe54904f279c91accb12a60bd8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237715111 2023-03-19 14:55:25,347 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 27e9860883f345a498fed03352deb5e2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237716526 2023-03-19 14:55:25,348 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting f89572fa317a4457914c3071fab047ec, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237717926 2023-03-19 14:55:25,348 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting f0f9cb4d4db343c2bcdaa0e9f21e0968, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:25,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/251792b5ce3f4b09aeb63172cce006ba, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/17955f70f13c44378d5df66d42d04461, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/496d6285a3024cd9828b2ce616711a33, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/45373520245d40029238129d8a83f350, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d31b6b8fb65247ac8ff5f218fff1342f] to archive 2023-03-19 14:55:25,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:25,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/251792b5ce3f4b09aeb63172cce006ba to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/251792b5ce3f4b09aeb63172cce006ba 2023-03-19 14:55:25,358 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): 87c27b1359899a7b93d3cb1ea602825a#family2#compaction#153 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:25,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/17955f70f13c44378d5df66d42d04461 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/17955f70f13c44378d5df66d42d04461 2023-03-19 14:55:25,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/496d6285a3024cd9828b2ce616711a33 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/496d6285a3024cd9828b2ce616711a33 2023-03-19 14:55:25,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/45373520245d40029238129d8a83f350 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/45373520245d40029238129d8a83f350 2023-03-19 14:55:25,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d31b6b8fb65247ac8ff5f218fff1342f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d31b6b8fb65247ac8ff5f218fff1342f 2023-03-19 14:55:25,773 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303199f975db931f647f68eb0210fc8d1300d_del 2023-03-19 14:55:25,773 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303199f975db931f647f68eb0210fc8d1300d_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303199f975db931f647f68eb0210fc8d1300d_del 2023-03-19 14:55:26,601 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44a9ec6b00d1460abb47bce4c9e3abfe 2023-03-19 14:55:26,603 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/.tmp/family2/44a9ec6b00d1460abb47bce4c9e3abfe as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/44a9ec6b00d1460abb47bce4c9e3abfe 2023-03-19 14:55:26,609 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44a9ec6b00d1460abb47bce4c9e3abfe 2023-03-19 14:55:26,610 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 87c27b1359899a7b93d3cb1ea602825a/family2 of 87c27b1359899a7b93d3cb1ea602825a into 44a9ec6b00d1460abb47bce4c9e3abfe(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:26,610 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:26,610 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:26,611 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): bdb5c439f8ed2752db29e637c75284e6/family1 is initiating major compaction (all files) 2023-03-19 14:55:26,611 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:26,611 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:26,611 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of bdb5c439f8ed2752db29e637c75284e6/family1 in ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:26,611 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/27e16c3686204db090596ff0277c22b8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/b3d5196e73ea4bc7b348755ad4c78841, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/2746fa654ec44e6aaec745b9928a523c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/7b9f596f22c74ee9a71cc74830dd83ea, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/f348f0e4f15b4d32b49eefe387abfcf5] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp, totalSize=26.6 K 2023-03-19 14:55:26,612 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 27e16c3686204db090596ff0277c22b8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237714070 2023-03-19 14:55:26,612 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting b3d5196e73ea4bc7b348755ad4c78841, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237715111 2023-03-19 14:55:26,612 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 2746fa654ec44e6aaec745b9928a523c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237716526 2023-03-19 14:55:26,613 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 7b9f596f22c74ee9a71cc74830dd83ea, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237717926 2023-03-19 14:55:26,613 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting f348f0e4f15b4d32b49eefe387abfcf5, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:26,623 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): bdb5c439f8ed2752db29e637c75284e6#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:26,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/a027db9c0b63410abf656738f200a579, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f079dcbe54904f279c91accb12a60bd8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/27e9860883f345a498fed03352deb5e2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f89572fa317a4457914c3071fab047ec, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f0f9cb4d4db343c2bcdaa0e9f21e0968] to archive 2023-03-19 14:55:26,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:26,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/a027db9c0b63410abf656738f200a579 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/a027db9c0b63410abf656738f200a579 2023-03-19 14:55:26,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f079dcbe54904f279c91accb12a60bd8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f079dcbe54904f279c91accb12a60bd8 2023-03-19 14:55:26,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/27e9860883f345a498fed03352deb5e2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/27e9860883f345a498fed03352deb5e2 2023-03-19 14:55:26,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f89572fa317a4457914c3071fab047ec to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f89572fa317a4457914c3071fab047ec 2023-03-19 14:55:26,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f0f9cb4d4db343c2bcdaa0e9f21e0968 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family2/f0f9cb4d4db343c2bcdaa0e9f21e0968 2023-03-19 14:55:27,042 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230319c8aafeaa80a9435ea686b269b3eafbed_del 2023-03-19 14:55:27,042 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319c8aafeaa80a9435ea686b269b3eafbed_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230319c8aafeaa80a9435ea686b269b3eafbed_del 2023-03-19 14:55:27,857 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22f3bf458cf94666ab868bf94d0a1f82 2023-03-19 14:55:27,857 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family1/22f3bf458cf94666ab868bf94d0a1f82 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/22f3bf458cf94666ab868bf94d0a1f82 2023-03-19 14:55:27,860 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22f3bf458cf94666ab868bf94d0a1f82 2023-03-19 14:55:27,861 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bdb5c439f8ed2752db29e637c75284e6/family1 of bdb5c439f8ed2752db29e637c75284e6 into 22f3bf458cf94666ab868bf94d0a1f82(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:27,861 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:27,861 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:27,861 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): bdb5c439f8ed2752db29e637c75284e6/family2 is initiating major compaction (all files) 2023-03-19 14:55:27,862 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:27,862 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:27,862 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of bdb5c439f8ed2752db29e637c75284e6/family2 in ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:27,862 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3802e6162e844513aebddfc924649e43, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/147b268442fe48dc9658f1932eef44d6, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/109c873c97dd430490e28aa963f1afac, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3651397558414aa485d1cb294d8afea8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/4f97a2b6da524df4ab3456ba0bd38963] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp, totalSize=25.3 K 2023-03-19 14:55:27,863 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 3802e6162e844513aebddfc924649e43, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237714070 2023-03-19 14:55:27,863 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 147b268442fe48dc9658f1932eef44d6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237715111 2023-03-19 14:55:27,863 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 109c873c97dd430490e28aa963f1afac, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237716526 2023-03-19 14:55:27,864 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 3651397558414aa485d1cb294d8afea8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237717926 2023-03-19 14:55:27,864 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 4f97a2b6da524df4ab3456ba0bd38963, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:27,872 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): bdb5c439f8ed2752db29e637c75284e6#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:27,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/27e16c3686204db090596ff0277c22b8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/b3d5196e73ea4bc7b348755ad4c78841, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/2746fa654ec44e6aaec745b9928a523c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/7b9f596f22c74ee9a71cc74830dd83ea, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/f348f0e4f15b4d32b49eefe387abfcf5] to archive 2023-03-19 14:55:27,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:27,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/27e16c3686204db090596ff0277c22b8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/27e16c3686204db090596ff0277c22b8 2023-03-19 14:55:27,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/b3d5196e73ea4bc7b348755ad4c78841 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/b3d5196e73ea4bc7b348755ad4c78841 2023-03-19 14:55:27,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/2746fa654ec44e6aaec745b9928a523c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/2746fa654ec44e6aaec745b9928a523c 2023-03-19 14:55:27,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/7b9f596f22c74ee9a71cc74830dd83ea to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/7b9f596f22c74ee9a71cc74830dd83ea 2023-03-19 14:55:27,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/f348f0e4f15b4d32b49eefe387abfcf5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/f348f0e4f15b4d32b49eefe387abfcf5 2023-03-19 14:55:28,283 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303198609f885fe4949329814984e27c9ed19_del 2023-03-19 14:55:28,284 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303198609f885fe4949329814984e27c9ed19_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303198609f885fe4949329814984e27c9ed19_del 2023-03-19 14:55:29,097 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 930c6bc47e044a7d80338e4db684f533 2023-03-19 14:55:29,098 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/.tmp/family2/930c6bc47e044a7d80338e4db684f533 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/930c6bc47e044a7d80338e4db684f533 2023-03-19 14:55:29,102 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 930c6bc47e044a7d80338e4db684f533 2023-03-19 14:55:29,103 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bdb5c439f8ed2752db29e637c75284e6/family2 of bdb5c439f8ed2752db29e637c75284e6 into 930c6bc47e044a7d80338e4db684f533(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:29,103 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:29,106 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:29,108 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:29,112 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:29,113 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:29,118 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-19 14:55:29,134 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-19 14:55:29,137 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230319c8aafeaa80a9435ea686b269b3eafbed_del 2023-03-19 14:55:29,140 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230319561ec584d2f646539f1aa3aedc1f19b1_del 2023-03-19 14:55:29,144 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023031951c3a555de4a4ef99a4a581de4f16a51_del 2023-03-19 14:55:29,144 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-19 14:55:29,144 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ReadOnlyZKClient(139): Connect 0x58b70d60 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:55:29,152 DEBUG [Listener at localhost.localdomain/46521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75cdc867, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:55:29,154 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230319 for table='ns:testMinorCompaction' and column='family1' 2023-03-19 14:55:29,154 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230319 for table='ns:testMinorCompaction' and column='family1' 2023-03-19 14:55:29,154 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230319 for table='ns:testMinorCompaction' and column='family1' 2023-03-19 14:55:29,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3802e6162e844513aebddfc924649e43, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/147b268442fe48dc9658f1932eef44d6, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/109c873c97dd430490e28aa963f1afac, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3651397558414aa485d1cb294d8afea8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/4f97a2b6da524df4ab3456ba0bd38963] to archive 2023-03-19 14:55:29,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:29,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3802e6162e844513aebddfc924649e43 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3802e6162e844513aebddfc924649e43 2023-03-19 14:55:29,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/147b268442fe48dc9658f1932eef44d6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/147b268442fe48dc9658f1932eef44d6 2023-03-19 14:55:29,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/109c873c97dd430490e28aa963f1afac to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/109c873c97dd430490e28aa963f1afac 2023-03-19 14:55:29,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3651397558414aa485d1cb294d8afea8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/3651397558414aa485d1cb294d8afea8 2023-03-19 14:55:29,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/4f97a2b6da524df4ab3456ba0bd38963 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family2/4f97a2b6da524df4ab3456ba0bd38963 2023-03-19 14:55:29,607 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031919610e9fe03344d28ac8b371057a97a7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023031919610e9fe03344d28ac8b371057a97a7 2023-03-19 14:55:29,608 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230319 table='ns:testMinorCompaction' column='family1' 2023-03-19 14:55:29,626 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:55:29,628 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55040, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:55:29,638 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:55:29,645 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50420, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:55:29,663 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230319/family1/ba4240b612344b29b887800125ada732 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-19 14:55:29,664 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230319/family1/ba4240b612344b29b887800125ada732}] 2023-03-19 14:55:29,676 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230319/family1/ba4240b612344b29b887800125ada732 for inclusion in bdb5c439f8ed2752db29e637c75284e6/family1 2023-03-19 14:55:29,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-19 14:55:29,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last=1 2023-03-19 14:55:29,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:29,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230319/family1/ba4240b612344b29b887800125ada732 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__hok2fque2v8rgarfstqp9mc4eepsc3ms0r0cijmdd9vu311srjqs4hm6vvv9ngr4/family1/ba4240b612344b29b887800125ada732 2023-03-19 14:55:29,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__hok2fque2v8rgarfstqp9mc4eepsc3ms0r0cijmdd9vu311srjqs4hm6vvv9ngr4/family1/ba4240b612344b29b887800125ada732 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/2d479b5024e64645b979bb772b6879ad_SeqId_28_ 2023-03-19 14:55:29,681 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__hok2fque2v8rgarfstqp9mc4eepsc3ms0r0cijmdd9vu311srjqs4hm6vvv9ngr4/family1/ba4240b612344b29b887800125ada732 into bdb5c439f8ed2752db29e637c75284e6/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/2d479b5024e64645b979bb772b6879ad_SeqId_28_ - updating store file list. 2023-03-19 14:55:29,684 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/2d479b5024e64645b979bb772b6879ad_SeqId_28_ into bdb5c439f8ed2752db29e637c75284e6/family1 2023-03-19 14:55:29,684 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__hok2fque2v8rgarfstqp9mc4eepsc3ms0r0cijmdd9vu311srjqs4hm6vvv9ngr4/family1/ba4240b612344b29b887800125ada732 into bdb5c439f8ed2752db29e637c75284e6/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/family1/2d479b5024e64645b979bb772b6879ad_SeqId_28_) 2023-03-19 14:55:29,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__hok2fque2v8rgarfstqp9mc4eepsc3ms0r0cijmdd9vu311srjqs4hm6vvv9ngr4/family1/ba4240b612344b29b887800125ada732 2023-03-19 14:55:29,687 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230319 table='ns:testMinorCompaction' column='family1' 2023-03-19 14:55:29,688 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:29,689 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303190e53ad63ace04f228f9fa136fe8bde24 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303190e53ad63ace04f228f9fa136fe8bde24 2023-03-19 14:55:29,689 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-19 14:55:29,689 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230319' 2023-03-19 14:55:29,689 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230319 for table='ns:testMinorCompaction' and column='family1' 2023-03-19 14:55:29,999 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031938fdbb6037584d0db9012f41332eac74 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023031938fdbb6037584d0db9012f41332eac74 2023-03-19 14:55:30,000 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230319 table='ns:testMinorCompaction' column='family1' 2023-03-19 14:55:30,007 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303192a14532e710d403db9ebbb43ad4a4732 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303192a14532e710d403db9ebbb43ad4a4732 2023-03-19 14:55:30,008 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230319 table='ns:testMinorCompaction' column='family1' 2023-03-19 14:55:30,031 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230319/family1/8890a506bbf84e8b8628bf4e368b236b first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-19 14:55:30,033 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230319/family1/8890a506bbf84e8b8628bf4e368b236b}] 2023-03-19 14:55:30,036 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230319/family1/8890a506bbf84e8b8628bf4e368b236b for inclusion in c07026313222798b71dcd0ce84d17a24/family1 2023-03-19 14:55:30,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-19 14:55:30,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-19 14:55:30,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:30,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230319/family1/8890a506bbf84e8b8628bf4e368b236b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__fkio61tmeduvdh2o7rcnjtram8l36npl992osra3s2lh3lr9k7vmtuep9ai0p22m/family1/8890a506bbf84e8b8628bf4e368b236b 2023-03-19 14:55:30,044 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230319/family1/3f52ba575c6f4c98a8e8c35392fc15da first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-19 14:55:30,045 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230319/family1/3f52ba575c6f4c98a8e8c35392fc15da}] 2023-03-19 14:55:30,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__fkio61tmeduvdh2o7rcnjtram8l36npl992osra3s2lh3lr9k7vmtuep9ai0p22m/family1/8890a506bbf84e8b8628bf4e368b236b as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/767950d5156e4c1da08923720fe4252b_SeqId_28_ 2023-03-19 14:55:30,047 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__fkio61tmeduvdh2o7rcnjtram8l36npl992osra3s2lh3lr9k7vmtuep9ai0p22m/family1/8890a506bbf84e8b8628bf4e368b236b into c07026313222798b71dcd0ce84d17a24/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/767950d5156e4c1da08923720fe4252b_SeqId_28_ - updating store file list. 2023-03-19 14:55:30,047 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230319/family1/3f52ba575c6f4c98a8e8c35392fc15da for inclusion in 87c27b1359899a7b93d3cb1ea602825a/family1 2023-03-19 14:55:30,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-19 14:55:30,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-19 14:55:30,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:30,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230319/family1/3f52ba575c6f4c98a8e8c35392fc15da to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__65r0kgvmgigb61ppc06kthr91td9koc622fhl1r2oj2tgibtco8mha4251fsvpgm/family1/3f52ba575c6f4c98a8e8c35392fc15da 2023-03-19 14:55:30,051 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/767950d5156e4c1da08923720fe4252b_SeqId_28_ into c07026313222798b71dcd0ce84d17a24/family1 2023-03-19 14:55:30,051 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__fkio61tmeduvdh2o7rcnjtram8l36npl992osra3s2lh3lr9k7vmtuep9ai0p22m/family1/8890a506bbf84e8b8628bf4e368b236b into c07026313222798b71dcd0ce84d17a24/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/family1/767950d5156e4c1da08923720fe4252b_SeqId_28_) 2023-03-19 14:55:30,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__fkio61tmeduvdh2o7rcnjtram8l36npl992osra3s2lh3lr9k7vmtuep9ai0p22m/family1/8890a506bbf84e8b8628bf4e368b236b 2023-03-19 14:55:30,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__65r0kgvmgigb61ppc06kthr91td9koc622fhl1r2oj2tgibtco8mha4251fsvpgm/family1/3f52ba575c6f4c98a8e8c35392fc15da as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d9e0a58a8b7848ecb92489c18350681e_SeqId_28_ 2023-03-19 14:55:30,053 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__65r0kgvmgigb61ppc06kthr91td9koc622fhl1r2oj2tgibtco8mha4251fsvpgm/family1/3f52ba575c6f4c98a8e8c35392fc15da into 87c27b1359899a7b93d3cb1ea602825a/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d9e0a58a8b7848ecb92489c18350681e_SeqId_28_ - updating store file list. 2023-03-19 14:55:30,053 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230319 table='ns:testMinorCompaction' column='family1' 2023-03-19 14:55:30,054 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:30,055 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303191f693b7750b04a6bac0ebf28d41395e9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202303191f693b7750b04a6bac0ebf28d41395e9 2023-03-19 14:55:30,055 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-19 14:55:30,055 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230319' 2023-03-19 14:55:30,056 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230319 for table='ns:testMinorCompaction' and column='family1' 2023-03-19 14:55:30,056 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d9e0a58a8b7848ecb92489c18350681e_SeqId_28_ into 87c27b1359899a7b93d3cb1ea602825a/family1 2023-03-19 14:55:30,056 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__65r0kgvmgigb61ppc06kthr91td9koc622fhl1r2oj2tgibtco8mha4251fsvpgm/family1/3f52ba575c6f4c98a8e8c35392fc15da into 87c27b1359899a7b93d3cb1ea602825a/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/family1/d9e0a58a8b7848ecb92489c18350681e_SeqId_28_) 2023-03-19 14:55:30,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__ns_testMinorCompaction__65r0kgvmgigb61ppc06kthr91td9koc622fhl1r2oj2tgibtco8mha4251fsvpgm/family1/3f52ba575c6f4c98a8e8c35392fc15da 2023-03-19 14:55:30,059 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230319 table='ns:testMinorCompaction' column='family1' 2023-03-19 14:55:30,059 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:30,061 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230319c075392907d1424eba0aa25d9fcaeab9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230319c075392907d1424eba0aa25d9fcaeab9 2023-03-19 14:55:30,061 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-19 14:55:30,061 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230319' 2023-03-19 14:55:30,062 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230319 for table='ns:testMinorCompaction' and column='family1' 2023-03-19 14:55:30,062 INFO [Listener at localhost.localdomain/46521] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-19 14:55:30,064 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:30,067 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:30,071 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:30,072 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:30,090 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=254 (was 278), OpenFileDescriptor=632 (was 740), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 156) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 168), AvailableMemoryMB=5459 (was 4123) - AvailableMemoryMB LEAK? - 2023-03-19 14:55:30,103 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=254, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=182, ProcessCount=165, AvailableMemoryMB=5448 2023-03-19 14:55:30,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-19 14:55:30,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:30,109 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:55:30,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-19 14:55:30,110 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:55:30,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-19 14:55:30,113 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96 2023-03-19 14:55:30,114 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96 empty. 2023-03-19 14:55:30,114 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96 2023-03-19 14:55:30,114 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-19 14:55:30,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-19 14:55:30,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-19 14:55:30,521 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-19 14:55:30,522 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1197adada65eae2db55735ff4e977a96, NAME => 'testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:55:30,526 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:30,527 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 1197adada65eae2db55735ff4e977a96, disabling compactions & flushes 2023-03-19 14:55:30,527 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:30,527 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:30,527 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. after waiting 0 ms 2023-03-19 14:55:30,527 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:30,527 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:30,527 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:30,529 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:55:30,530 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679237730529"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237730529"}]},"ts":"1679237730529"} 2023-03-19 14:55:30,531 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-19 14:55:30,531 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:55:30,531 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237730531"}]},"ts":"1679237730531"} 2023-03-19 14:55:30,532 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-19 14:55:30,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=1197adada65eae2db55735ff4e977a96, ASSIGN}] 2023-03-19 14:55:30,538 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=1197adada65eae2db55735ff4e977a96, ASSIGN 2023-03-19 14:55:30,539 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=1197adada65eae2db55735ff4e977a96, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:55:30,690 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=1197adada65eae2db55735ff4e977a96, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:30,690 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679237730690"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237730690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237730690"}]},"ts":"1679237730690"} 2023-03-19 14:55:30,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 1197adada65eae2db55735ff4e977a96, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:30,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-19 14:55:30,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:30,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1197adada65eae2db55735ff4e977a96, NAME => 'testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96.', STARTKEY => '', ENDKEY => ''} 2023-03-19 14:55:30,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 1197adada65eae2db55735ff4e977a96 2023-03-19 14:55:30,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:30,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1197adada65eae2db55735ff4e977a96 2023-03-19 14:55:30,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1197adada65eae2db55735ff4e977a96 2023-03-19 14:55:30,846 INFO [StoreOpener-1197adada65eae2db55735ff4e977a96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1197adada65eae2db55735ff4e977a96 2023-03-19 14:55:30,848 DEBUG [StoreOpener-1197adada65eae2db55735ff4e977a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1 2023-03-19 14:55:30,848 DEBUG [StoreOpener-1197adada65eae2db55735ff4e977a96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1 2023-03-19 14:55:30,848 INFO [StoreOpener-1197adada65eae2db55735ff4e977a96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1197adada65eae2db55735ff4e977a96 columnFamilyName family1 2023-03-19 14:55:30,849 INFO [StoreOpener-1197adada65eae2db55735ff4e977a96-1] regionserver.HStore(310): Store=1197adada65eae2db55735ff4e977a96/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:30,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96 2023-03-19 14:55:30,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96 2023-03-19 14:55:30,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1197adada65eae2db55735ff4e977a96 2023-03-19 14:55:30,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:55:30,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1197adada65eae2db55735ff4e977a96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69519240, jitterRate=0.03591740131378174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-19 14:55:30,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:30,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96., pid=114, masterSystemTime=1679237730842 2023-03-19 14:55:30,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:30,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:30,856 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=1197adada65eae2db55735ff4e977a96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:30,856 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1679237730856"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237730856"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237730856"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237730856"}]},"ts":"1679237730856"} 2023-03-19 14:55:30,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-19 14:55:30,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 1197adada65eae2db55735ff4e977a96, server=jenkins-hbase20.apache.org,33191,1679237584457 in 166 msec 2023-03-19 14:55:30,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-19 14:55:30,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=1197adada65eae2db55735ff4e977a96, ASSIGN in 324 msec 2023-03-19 14:55:30,860 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:55:30,860 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237730860"}]},"ts":"1679237730860"} 2023-03-19 14:55:30,861 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-19 14:55:30,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:55:30,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 756 msec 2023-03-19 14:55:31,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-19 14:55:31,215 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-19 14:55:31,247 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:55:31,248 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58b70d60 to 127.0.0.1:56323 2023-03-19 14:55:31,248 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:55:31,248 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:55:31,248 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1aadab53 to 127.0.0.1:56323 2023-03-19 14:55:31,249 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:55:31,249 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:55:31,249 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b003a50 to 127.0.0.1:56323 2023-03-19 14:55:31,249 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:55:31,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:31,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:31,254 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:31,254 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:31,254 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:55:31,254 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:55:31,255 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:31,255 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:31,258 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:31,258 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:31,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:31,258 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:31,258 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:31,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:31,259 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:31,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:31,259 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:55:31,259 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:31,259 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:55:31,262 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:55:31,262 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:31,262 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:31,262 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. started... 2023-03-19 14:55:31,263 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1197adada65eae2db55735ff4e977a96 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-19 14:55:31,689 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305d66f36ca2c14b2c8c788d6523c57020 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511305d66f36ca2c14b2c8c788d6523c57020 2023-03-19 14:55:32,092 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/123e192d35e54dfb97132a0fae58e2c8 2023-03-19 14:55:32,096 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/123e192d35e54dfb97132a0fae58e2c8 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/123e192d35e54dfb97132a0fae58e2c8 2023-03-19 14:55:32,099 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/123e192d35e54dfb97132a0fae58e2c8, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-19 14:55:32,100 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1197adada65eae2db55735ff4e977a96 in 837ms, sequenceid=5, compaction requested=false 2023-03-19 14:55:32,100 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:32,100 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:32,100 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:32,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:55:32,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:55:32,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:55:32,100 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:55:32,101 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,101 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:32,101 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,101 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:32,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:55:32,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d8660ad[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:32,102 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:55:32,103 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,103 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,103 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:55:32,103 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:55:32,103 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,103 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:32,103 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:32,104 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:55:32,104 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,104 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:32,104 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:55:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:32,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:32,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:55:32,105 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:55:32,105 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:32,105 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:32,105 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,105 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:32,106 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,106 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:32,106 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:32,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:32,106 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,107 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,108 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,108 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:32,108 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:32,109 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:32,108 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:32,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:32,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:32,108 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,109 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,109 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,109 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,109 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:32,109 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:32,109 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:32,209 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:32,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:32,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:32,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:32,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,215 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:32,215 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:32,215 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:55:32,215 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:55:32,215 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,215 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,216 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,216 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:32,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:32,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:32,216 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:32,216 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:32,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:32,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,217 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,217 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:55:32,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:32,217 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:55:32,217 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:32,217 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:55:32,218 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:55:32,218 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:32,218 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:32,218 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. started... 2023-03-19 14:55:32,218 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1197adada65eae2db55735ff4e977a96 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-19 14:55:32,628 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288cffc03b95cb492699a1e75e6a17a949 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288cffc03b95cb492699a1e75e6a17a949 2023-03-19 14:55:33,033 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/f515e40d2d954ae182801e5b72c10378 2023-03-19 14:55:33,043 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/f515e40d2d954ae182801e5b72c10378 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f515e40d2d954ae182801e5b72c10378 2023-03-19 14:55:33,048 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f515e40d2d954ae182801e5b72c10378, entries=1, sequenceid=9, filesize=5.0 K 2023-03-19 14:55:33,049 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1197adada65eae2db55735ff4e977a96 in 831ms, sequenceid=9, compaction requested=false 2023-03-19 14:55:33,049 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:33,049 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:33,049 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:55:33,049 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:55:33,049 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,049 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:55:33,049 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:55:33,050 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,050 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:33,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:33,051 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:33,051 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:33,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:33,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:33,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:55:33,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ada2c29[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:33,052 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:55:33,053 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,053 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,053 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:55:33,053 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:55:33,053 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:33,054 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,054 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:33,055 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:55:33,055 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,055 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:33,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,055 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:55:33,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:33,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:33,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:33,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:33,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:33,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:33,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:55:33,059 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:55:33,059 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:33,059 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:33,059 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,059 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:33,066 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,066 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,066 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:33,067 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:33,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,068 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,075 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,075 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,075 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:33,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:33,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:33,075 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:33,075 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:33,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:55:33,075 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:33,075 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,075 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:33,076 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:33,076 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,076 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,076 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:33,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:33,176 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:33,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:33,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:33,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:33,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,182 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:33,182 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:33,182 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:55:33,182 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:55:33,183 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,183 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,183 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:33,183 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:33,184 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,184 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,184 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,184 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:55:33,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,185 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:55:33,185 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:33,185 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:55:33,185 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:55:33,185 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:33,185 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:33,185 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. started... 2023-03-19 14:55:33,185 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1197adada65eae2db55735ff4e977a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:55:33,599 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201cdd977e9f50a41be992e61780fd4d925 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201cdd977e9f50a41be992e61780fd4d925 2023-03-19 14:55:33,604 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/5ea0e1cd3cf44154ac9b3cfaf4eca9ce 2023-03-19 14:55:33,610 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/5ea0e1cd3cf44154ac9b3cfaf4eca9ce as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/5ea0e1cd3cf44154ac9b3cfaf4eca9ce 2023-03-19 14:55:33,614 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/5ea0e1cd3cf44154ac9b3cfaf4eca9ce, entries=1, sequenceid=13, filesize=4.9 K 2023-03-19 14:55:33,615 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1197adada65eae2db55735ff4e977a96 in 430ms, sequenceid=13, compaction requested=true 2023-03-19 14:55:33,615 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:33,615 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:33,615 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:55:33,615 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:55:33,615 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,615 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:55:33,615 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:55:33,616 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,616 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:33,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:33,617 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,617 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:33,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:55:33,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5eee449[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:33,618 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:55:33,618 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,618 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,618 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:55:33,619 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:55:33,619 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:33,619 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,619 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:33,619 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:55:33,619 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,619 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:33,619 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:55:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:33,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:55:33,621 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:55:33,621 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:33,621 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:33,621 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,621 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:33,622 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,622 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:33,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,622 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:33,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:33,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:33,623 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:33,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:33,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:33,624 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,625 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:33,625 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:33,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:33,625 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:33,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:33,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:33,625 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:33,625 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,625 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,625 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,626 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,626 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,626 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,626 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:33,626 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:33,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:55:33,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:33,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:33,726 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:33,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:33,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:33,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:33,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,731 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:33,731 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:33,731 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:55:33,731 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:55:33,732 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,732 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,732 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,732 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:33,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:33,733 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:33,733 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:33,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:55:33,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:33,734 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:55:33,734 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:33,734 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:55:33,734 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:55:33,734 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:33,734 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:33,734 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. started... 2023-03-19 14:55:33,734 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1197adada65eae2db55735ff4e977a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:55:34,146 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051cfec2574b984f09b7ecf7836dbc3a3c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512051cfec2574b984f09b7ecf7836dbc3a3c 2023-03-19 14:55:34,552 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/7a9594c7b65b446d9789775d1120a43b 2023-03-19 14:55:34,558 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/7a9594c7b65b446d9789775d1120a43b as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/7a9594c7b65b446d9789775d1120a43b 2023-03-19 14:55:34,563 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/7a9594c7b65b446d9789775d1120a43b, entries=1, sequenceid=17, filesize=4.9 K 2023-03-19 14:55:34,564 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1197adada65eae2db55735ff4e977a96 in 830ms, sequenceid=17, compaction requested=true 2023-03-19 14:55:34,564 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:34,564 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:34,564 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:55:34,564 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:55:34,564 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,564 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:55:34,564 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:55:34,566 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,566 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:34,566 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,566 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:34,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:34,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:34,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:34,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:55:34,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@316b5bed[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:34,568 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:55:34,568 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,569 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,569 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:55:34,570 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:55:34,570 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:34,570 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,570 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:34,571 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,571 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:55:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:34,571 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:34,571 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:55:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:34,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:34,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:34,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:55:34,573 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:55:34,573 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:34,573 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:34,573 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,574 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:34,575 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,575 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:34,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,575 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:34,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:34,575 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:34,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:34,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,577 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,579 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,579 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:34,579 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,579 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:34,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:55:34,579 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,579 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,579 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:34,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:34,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:34,579 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:34,580 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:34,580 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,580 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:34,580 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:34,680 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:34,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:34,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:34,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:34,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,691 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:34,691 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:34,691 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:55:34,691 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:55:34,692 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,692 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,693 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,693 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:34,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:34,694 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:34,694 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,695 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,695 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:55:34,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:34,695 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:55:34,695 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:34,695 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:55:34,698 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:55:34,698 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:34,698 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:34,698 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. started... 2023-03-19 14:55:34,698 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1197adada65eae2db55735ff4e977a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:55:34,708 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228dd4a0a1e8369417e8560ea416c5a881b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228dd4a0a1e8369417e8560ea416c5a881b 2023-03-19 14:55:35,115 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/52972cea675840b38e0f80f4a3df1f57 2023-03-19 14:55:35,119 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/52972cea675840b38e0f80f4a3df1f57 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/52972cea675840b38e0f80f4a3df1f57 2023-03-19 14:55:35,122 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/52972cea675840b38e0f80f4a3df1f57, entries=1, sequenceid=21, filesize=4.9 K 2023-03-19 14:55:35,122 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1197adada65eae2db55735ff4e977a96 in 424ms, sequenceid=21, compaction requested=true 2023-03-19 14:55:35,122 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:35,122 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:35,122 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:55:35,122 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:55:35,122 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,122 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:55:35,122 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:55:35,124 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,124 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:35,124 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,124 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:35,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:35,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:55:35,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fa6c665[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:35,125 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:55:35,125 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,126 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,126 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:55:35,126 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:55:35,126 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:35,126 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,126 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:35,131 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,131 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:55:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:35,131 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:35,131 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:55:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:35,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:35,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:55:35,133 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:55:35,133 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:35,133 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:35,133 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,133 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:35,135 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,135 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:35,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,135 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:35,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:35,136 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:35,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,137 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:35,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,138 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,139 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,139 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:35,139 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,139 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:35,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:35,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:35,139 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:35,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:35,139 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:35,139 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,139 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,139 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:35,139 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:35,139 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:35,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:35,240 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:35,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:35,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:35,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:35,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,246 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:35,246 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:35,246 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:55:35,246 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:55:35,247 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,247 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,248 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,248 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:35,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:35,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:35,248 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:35,248 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:35,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:35,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,249 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,249 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:55:35,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:35,250 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:55:35,250 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:35,250 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:55:35,250 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:55:35,250 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:35,250 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:35,250 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. started... 2023-03-19 14:55:35,250 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1197adada65eae2db55735ff4e977a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:55:35,665 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ccc4b36a434f4d4dbb790d9727a41631 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ccc4b36a434f4d4dbb790d9727a41631 2023-03-19 14:55:36,069 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/a29c5a78b666464eb7ec3c7f3ef6139b 2023-03-19 14:55:36,074 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/a29c5a78b666464eb7ec3c7f3ef6139b as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/a29c5a78b666464eb7ec3c7f3ef6139b 2023-03-19 14:55:36,077 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/a29c5a78b666464eb7ec3c7f3ef6139b, entries=1, sequenceid=25, filesize=4.9 K 2023-03-19 14:55:36,078 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1197adada65eae2db55735ff4e977a96 in 828ms, sequenceid=25, compaction requested=true 2023-03-19 14:55:36,078 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:36,078 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:36,078 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:55:36,078 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:55:36,078 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,078 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:55:36,078 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:55:36,079 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,079 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:36,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:36,079 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,079 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:36,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:36,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:36,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:36,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:55:36,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@345606dc[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:36,080 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:55:36,080 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,081 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,081 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:55:36,081 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:55:36,081 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:36,081 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,081 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:36,081 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,081 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:55:36,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:36,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:36,082 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:36,082 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:55:36,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:36,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:36,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:36,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:36,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:55:36,084 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:55:36,084 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:36,084 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:36,084 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,084 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:36,085 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,085 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,085 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:36,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:36,085 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,086 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,087 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,087 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:36,087 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,087 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:36,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:55:36,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:36,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:36,087 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:36,087 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:36,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:36,087 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,088 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:36,088 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,088 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:36,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:36,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:36,088 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,088 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,188 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:36,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:36,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:36,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:36,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,193 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:36,193 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:36,193 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:55:36,193 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:55:36,194 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,194 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,194 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:36,194 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:36,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:36,195 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:36,195 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,195 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,196 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:55:36,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:36,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:55:36,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:36,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:55:36,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:55:36,196 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:36,196 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:36,196 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. started... 2023-03-19 14:55:36,196 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1197adada65eae2db55735ff4e977a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:55:36,385 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:55:36,615 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018f097cbf92e74457a59addbe05ff9274 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018f097cbf92e74457a59addbe05ff9274 2023-03-19 14:55:37,022 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/04d0f63b826248a299088c0f77bbc626 2023-03-19 14:55:37,032 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/04d0f63b826248a299088c0f77bbc626 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/04d0f63b826248a299088c0f77bbc626 2023-03-19 14:55:37,037 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/04d0f63b826248a299088c0f77bbc626, entries=1, sequenceid=29, filesize=4.9 K 2023-03-19 14:55:37,038 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1197adada65eae2db55735ff4e977a96 in 842ms, sequenceid=29, compaction requested=true 2023-03-19 14:55:37,038 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:37,038 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:37,039 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:55:37,039 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:55:37,039 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,039 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:55:37,039 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:55:37,040 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,040 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:37,041 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,041 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46e870b3[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:37,043 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:55:37,044 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,044 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,045 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:55:37,045 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:55:37,045 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:37,045 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,045 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:37,046 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:55:37,046 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:37,046 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,046 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:55:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:37,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:55:37,049 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:55:37,049 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:37,050 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:37,050 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,050 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:37,051 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,051 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:37,051 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:37,051 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,053 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:37,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,055 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,056 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:37,056 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,056 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:37,056 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:37,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:37,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:37,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:55:37,056 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:37,056 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:37,056 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:37,057 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,056 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:37,057 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:37,057 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,157 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:37,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:37,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:37,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:37,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,165 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:37,165 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:37,165 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:55:37,165 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:55:37,166 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,166 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,167 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,167 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:37,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:37,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:37,168 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:37,168 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:37,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:37,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,170 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,170 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:55:37,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:37,170 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:55:37,170 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:37,170 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:55:37,170 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:55:37,170 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:37,170 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:37,171 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. started... 2023-03-19 14:55:37,171 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1197adada65eae2db55735ff4e977a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:55:37,590 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f50ada5909914475862f6ba3f08cb4a6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103f50ada5909914475862f6ba3f08cb4a6 2023-03-19 14:55:37,998 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/f5d24676da7c4fff88d5e84f2833e5c1 2023-03-19 14:55:38,008 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/f5d24676da7c4fff88d5e84f2833e5c1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f5d24676da7c4fff88d5e84f2833e5c1 2023-03-19 14:55:38,016 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f5d24676da7c4fff88d5e84f2833e5c1, entries=1, sequenceid=33, filesize=4.9 K 2023-03-19 14:55:38,017 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1197adada65eae2db55735ff4e977a96 in 846ms, sequenceid=33, compaction requested=true 2023-03-19 14:55:38,017 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:38,017 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:38,017 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:55:38,017 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:55:38,017 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,017 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:55:38,017 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:55:38,019 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,019 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:38,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:38,019 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,019 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:38,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:38,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:55:38,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2db7efb0[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:38,022 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:55:38,022 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,023 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,023 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:55:38,023 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:55:38,023 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:38,023 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,023 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:38,025 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:55:38,026 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:38,026 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,026 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:55:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:38,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:38,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:55:38,031 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:55:38,031 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:38,031 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:38,031 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,031 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:38,034 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,034 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,034 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:38,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:38,035 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,037 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,043 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:38,043 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:38,043 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,043 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:38,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:38,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:55:38,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:38,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:38,043 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:38,044 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,044 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,044 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,044 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:38,044 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,044 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,044 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:38,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:38,145 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:38,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:38,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:38,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:38,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,157 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:38,157 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:38,157 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:55:38,157 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:55:38,157 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,157 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,158 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,158 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:38,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:38,158 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,159 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:38,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:38,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,160 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,160 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:55:38,160 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,160 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:55:38,160 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:38,160 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:55:38,160 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:55:38,160 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:38,160 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:38,160 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. started... 2023-03-19 14:55:38,160 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1197adada65eae2db55735ff4e977a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:55:38,578 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090749b6a219ce8547dc851fa15210845580 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090749b6a219ce8547dc851fa15210845580 2023-03-19 14:55:38,984 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/d1314a7df48f408c82775a818bc31fda 2023-03-19 14:55:38,988 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/d1314a7df48f408c82775a818bc31fda as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/d1314a7df48f408c82775a818bc31fda 2023-03-19 14:55:38,992 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/d1314a7df48f408c82775a818bc31fda, entries=1, sequenceid=37, filesize=4.9 K 2023-03-19 14:55:38,992 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1197adada65eae2db55735ff4e977a96 in 832ms, sequenceid=37, compaction requested=true 2023-03-19 14:55:38,992 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:38,992 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:38,992 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:55:38,992 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:55:38,993 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,993 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:55:38,993 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:55:38,993 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,993 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:38,994 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,994 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:38,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:55:38,995 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:55:38,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64eb918d[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:38,995 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,995 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,995 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:55:38,995 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,996 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:38,995 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:55:38,996 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:38,996 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:55:38,996 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,996 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:38,996 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:55:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:38,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:55:38,998 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:55:38,998 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:38,998 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:38,998 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,998 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:38,999 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,999 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,999 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:39,000 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:39,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,001 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,005 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:39,005 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:39,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:39,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:39,006 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,006 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,006 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,006 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,006 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,006 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,006 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,006 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:39,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:39,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:39,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:39,006 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:39,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:39,006 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:39,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:39,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-19 14:55:39,107 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:39,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:39,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:39,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:39,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,130 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:39,130 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:39,130 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-19 14:55:39,130 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-19 14:55:39,130 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,130 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,131 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,131 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:39,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:39,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:39,132 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,132 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:39,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,133 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,134 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-19 14:55:39,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,134 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-19 14:55:39,134 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:39,134 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-19 14:55:39,142 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-19 14:55:39,142 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:39,142 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:39,142 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. started... 2023-03-19 14:55:39,142 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1197adada65eae2db55735ff4e977a96 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-19 14:55:39,186 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c6394ce868074cfe8af1014d7329a129 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c6394ce868074cfe8af1014d7329a129 2023-03-19 14:55:39,197 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/bcb926c913ad43e1ac26cf6e4122933f 2023-03-19 14:55:39,202 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/bcb926c913ad43e1ac26cf6e4122933f as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/bcb926c913ad43e1ac26cf6e4122933f 2023-03-19 14:55:39,211 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/bcb926c913ad43e1ac26cf6e4122933f, entries=1, sequenceid=41, filesize=4.9 K 2023-03-19 14:55:39,212 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1197adada65eae2db55735ff4e977a96 in 70ms, sequenceid=41, compaction requested=true 2023-03-19 14:55:39,212 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:39,212 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:39,212 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-19 14:55:39,213 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-19 14:55:39,213 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,213 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-19 14:55:39,213 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-19 14:55:39,214 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,214 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:39,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:39,214 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:39,215 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:39,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-19 14:55:39,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@608f0b2a[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:39,216 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-19 14:55:39,216 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,217 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,217 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-19 14:55:39,217 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-19 14:55:39,217 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:39,219 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,219 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:39,219 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,219 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-19 14:55:39,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:39,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:39,219 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:39,220 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-19 14:55:39,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:39,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:39,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:39,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:39,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-19 14:55:39,222 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-19 14:55:39,222 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:39,222 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:39,222 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,222 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:39,230 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,230 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,230 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:39,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,231 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,234 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,238 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:39,238 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:39,238 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,238 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:39,238 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,238 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:39,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-19 14:55:39,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:39,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:39,238 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:39,239 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,239 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,239 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,239 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:39,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:39,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:39,239 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:39,339 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:39,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:39,341 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-19 14:55:39,343 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:55:39,344 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:55:39,345 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:55:39,345 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238339345 2023-03-19 14:55:39,345 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-19 14:55:39,346 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-19 14:55:39,346 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:55:39,347 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x51d54719 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:55:39,368 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d6f6bd6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:55:39,369 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:55:40,239 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038bd4add95fd4495782705fe23b735565 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601038bd4add95fd4495782705fe23b735565 2023-03-19 14:55:40,240 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:55:40,264 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:55:40,266 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49942, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:55:40,274 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:55:40,275 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47112, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:55:40,313 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e56a8771bee144919c4fcd058e2083c1 first=Optional[r5] last=Optional[r6] 2023-03-19 14:55:40,313 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e56a8771bee144919c4fcd058e2083c1}] 2023-03-19 14:55:40,323 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e56a8771bee144919c4fcd058e2083c1 for inclusion in 1197adada65eae2db55735ff4e977a96/family1 2023-03-19 14:55:40,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-19 14:55:40,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:55:40,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:40,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/e56a8771bee144919c4fcd058e2083c1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jj9nqemtrh15qasj89p94l5bldpi2akndn5nd2s3dbpga3e9hk0oj1iu4vcff5uh/family1/e56a8771bee144919c4fcd058e2083c1 2023-03-19 14:55:40,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jj9nqemtrh15qasj89p94l5bldpi2akndn5nd2s3dbpga3e9hk0oj1iu4vcff5uh/family1/e56a8771bee144919c4fcd058e2083c1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/eb520d81a1ad4e589d87c19ec9c13de8_SeqId_44_ 2023-03-19 14:55:40,330 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jj9nqemtrh15qasj89p94l5bldpi2akndn5nd2s3dbpga3e9hk0oj1iu4vcff5uh/family1/e56a8771bee144919c4fcd058e2083c1 into 1197adada65eae2db55735ff4e977a96/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/eb520d81a1ad4e589d87c19ec9c13de8_SeqId_44_ - updating store file list. 2023-03-19 14:55:40,336 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/eb520d81a1ad4e589d87c19ec9c13de8_SeqId_44_ into 1197adada65eae2db55735ff4e977a96/family1 2023-03-19 14:55:40,336 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jj9nqemtrh15qasj89p94l5bldpi2akndn5nd2s3dbpga3e9hk0oj1iu4vcff5uh/family1/e56a8771bee144919c4fcd058e2083c1 into 1197adada65eae2db55735ff4e977a96/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/eb520d81a1ad4e589d87c19ec9c13de8_SeqId_44_) 2023-03-19 14:55:40,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jj9nqemtrh15qasj89p94l5bldpi2akndn5nd2s3dbpga3e9hk0oj1iu4vcff5uh/family1/e56a8771bee144919c4fcd058e2083c1 2023-03-19 14:55:40,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-19 14:55:40,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-19 14:55:40,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(1912): 1197adada65eae2db55735ff4e977a96/family1 is initiating minor compaction 2023-03-19 14:55:40,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4be523d4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:55:40,341 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1197adada65eae2db55735ff4e977a96/family1 in testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:40,342 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f515e40d2d954ae182801e5b72c10378, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/5ea0e1cd3cf44154ac9b3cfaf4eca9ce, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/7a9594c7b65b446d9789775d1120a43b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/52972cea675840b38e0f80f4a3df1f57, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/a29c5a78b666464eb7ec3c7f3ef6139b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/04d0f63b826248a299088c0f77bbc626, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f5d24676da7c4fff88d5e84f2833e5c1, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/d1314a7df48f408c82775a818bc31fda, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/bcb926c913ad43e1ac26cf6e4122933f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/eb520d81a1ad4e589d87c19ec9c13de8_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp, totalSize=49.7 K 2023-03-19 14:55:40,342 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting f515e40d2d954ae182801e5b72c10378, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-19 14:55:40,342 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 5ea0e1cd3cf44154ac9b3cfaf4eca9ce, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-19 14:55:40,342 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 7a9594c7b65b446d9789775d1120a43b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-19 14:55:40,342 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 52972cea675840b38e0f80f4a3df1f57, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-19 14:55:40,342 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting a29c5a78b666464eb7ec3c7f3ef6139b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-19 14:55:40,342 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 04d0f63b826248a299088c0f77bbc626, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-19 14:55:40,342 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting f5d24676da7c4fff88d5e84f2833e5c1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-19 14:55:40,342 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting d1314a7df48f408c82775a818bc31fda, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-19 14:55:40,343 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting bcb926c913ad43e1ac26cf6e4122933f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-19 14:55:40,343 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting eb520d81a1ad4e589d87c19ec9c13de8_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-19 14:55:40,343 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:55:40,344 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:40,345 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018f097cbf92e74457a59addbe05ff9274 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018f097cbf92e74457a59addbe05ff9274 2023-03-19 14:55:40,346 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103f50ada5909914475862f6ba3f08cb4a6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103f50ada5909914475862f6ba3f08cb4a6 2023-03-19 14:55:40,347 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-19 14:55:40,347 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-19 14:55:40,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:55:40,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:55:40,361 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1197adada65eae2db55735ff4e977a96#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-19 14:55:40,821 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/ee5175ed19ab4cd3b36c6535a3fd31a3 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/ee5175ed19ab4cd3b36c6535a3fd31a3 2023-03-19 14:55:40,833 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1197adada65eae2db55735ff4e977a96/family1 of 1197adada65eae2db55735ff4e977a96 into ee5175ed19ab4cd3b36c6535a3fd31a3(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:40,833 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:40,833 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1679237740341; duration=0sec 2023-03-19 14:55:40,833 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:55:40,837 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b74e2377f2934970a56251a50366cbbc to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231b74e2377f2934970a56251a50366cbbc 2023-03-19 14:55:40,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:55:40,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f515e40d2d954ae182801e5b72c10378, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/5ea0e1cd3cf44154ac9b3cfaf4eca9ce, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/7a9594c7b65b446d9789775d1120a43b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/52972cea675840b38e0f80f4a3df1f57, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/a29c5a78b666464eb7ec3c7f3ef6139b, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/04d0f63b826248a299088c0f77bbc626, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f5d24676da7c4fff88d5e84f2833e5c1, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/d1314a7df48f408c82775a818bc31fda, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/bcb926c913ad43e1ac26cf6e4122933f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/eb520d81a1ad4e589d87c19ec9c13de8_SeqId_44_] to archive 2023-03-19 14:55:40,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:40,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f515e40d2d954ae182801e5b72c10378 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f515e40d2d954ae182801e5b72c10378 2023-03-19 14:55:40,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/5ea0e1cd3cf44154ac9b3cfaf4eca9ce to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/5ea0e1cd3cf44154ac9b3cfaf4eca9ce 2023-03-19 14:55:40,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/7a9594c7b65b446d9789775d1120a43b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/7a9594c7b65b446d9789775d1120a43b 2023-03-19 14:55:40,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/52972cea675840b38e0f80f4a3df1f57 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/52972cea675840b38e0f80f4a3df1f57 2023-03-19 14:55:40,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/a29c5a78b666464eb7ec3c7f3ef6139b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/a29c5a78b666464eb7ec3c7f3ef6139b 2023-03-19 14:55:40,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/04d0f63b826248a299088c0f77bbc626 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/04d0f63b826248a299088c0f77bbc626 2023-03-19 14:55:40,876 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f5d24676da7c4fff88d5e84f2833e5c1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/f5d24676da7c4fff88d5e84f2833e5c1 2023-03-19 14:55:40,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/d1314a7df48f408c82775a818bc31fda to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/d1314a7df48f408c82775a818bc31fda 2023-03-19 14:55:40,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/bcb926c913ad43e1ac26cf6e4122933f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/bcb926c913ad43e1ac26cf6e4122933f 2023-03-19 14:55:40,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/eb520d81a1ad4e589d87c19ec9c13de8_SeqId_44_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/eb520d81a1ad4e589d87c19ec9c13de8_SeqId_44_ 2023-03-19 14:55:40,915 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c7b899096f6c4222922a3f0067fa8105 first=Optional[r1] last=Optional[r4] 2023-03-19 14:55:40,916 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c7b899096f6c4222922a3f0067fa8105}] 2023-03-19 14:55:40,918 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c7b899096f6c4222922a3f0067fa8105 for inclusion in 1197adada65eae2db55735ff4e977a96/family1 2023-03-19 14:55:40,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-19 14:55:40,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:55:40,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:40,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c7b899096f6c4222922a3f0067fa8105 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q2kikqphkc57pjiepbqfvo1iib7p43ilcu4l91go6pchg2jnqq11ckfjj7qlc0lb/family1/c7b899096f6c4222922a3f0067fa8105 2023-03-19 14:55:40,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q2kikqphkc57pjiepbqfvo1iib7p43ilcu4l91go6pchg2jnqq11ckfjj7qlc0lb/family1/c7b899096f6c4222922a3f0067fa8105 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/b184a6dbf4604cf4a8a47f61f9a6ab38_SeqId_47_ 2023-03-19 14:55:40,925 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q2kikqphkc57pjiepbqfvo1iib7p43ilcu4l91go6pchg2jnqq11ckfjj7qlc0lb/family1/c7b899096f6c4222922a3f0067fa8105 into 1197adada65eae2db55735ff4e977a96/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/b184a6dbf4604cf4a8a47f61f9a6ab38_SeqId_47_ - updating store file list. 2023-03-19 14:55:40,931 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/b184a6dbf4604cf4a8a47f61f9a6ab38_SeqId_47_ into 1197adada65eae2db55735ff4e977a96/family1 2023-03-19 14:55:40,931 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q2kikqphkc57pjiepbqfvo1iib7p43ilcu4l91go6pchg2jnqq11ckfjj7qlc0lb/family1/c7b899096f6c4222922a3f0067fa8105 into 1197adada65eae2db55735ff4e977a96/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/b184a6dbf4604cf4a8a47f61f9a6ab38_SeqId_47_) 2023-03-19 14:55:40,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q2kikqphkc57pjiepbqfvo1iib7p43ilcu4l91go6pchg2jnqq11ckfjj7qlc0lb/family1/c7b899096f6c4222922a3f0067fa8105 2023-03-19 14:55:40,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-19 14:55:40,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-19 14:55:40,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(1912): 1197adada65eae2db55735ff4e977a96/family1 is initiating minor compaction (all files) 2023-03-19 14:55:40,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2a0a4bd2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:55:40,934 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1197adada65eae2db55735ff4e977a96/family1 in testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:40,934 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/123e192d35e54dfb97132a0fae58e2c8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/ee5175ed19ab4cd3b36c6535a3fd31a3, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/b184a6dbf4604cf4a8a47f61f9a6ab38_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp, totalSize=178.1 K 2023-03-19 14:55:40,934 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting 123e192d35e54dfb97132a0fae58e2c8, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878808483 2023-03-19 14:55:40,935 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting ee5175ed19ab4cd3b36c6535a3fd31a3, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621208483 2023-03-19 14:55:40,935 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] compactions.Compactor(207): Compacting b184a6dbf4604cf4a8a47f61f9a6ab38_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965208483 2023-03-19 14:55:40,936 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:55:40,937 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:40,939 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201cdd977e9f50a41be992e61780fd4d925 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201cdd977e9f50a41be992e61780fd4d925 2023-03-19 14:55:40,940 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512051cfec2574b984f09b7ecf7836dbc3a3c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512051cfec2574b984f09b7ecf7836dbc3a3c 2023-03-19 14:55:40,942 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228dd4a0a1e8369417e8560ea416c5a881b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228dd4a0a1e8369417e8560ea416c5a881b 2023-03-19 14:55:40,943 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ccc4b36a434f4d4dbb790d9727a41631 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ccc4b36a434f4d4dbb790d9727a41631 2023-03-19 14:55:40,943 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-19 14:55:40,943 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-19 14:55:40,944 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:55:40,944 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:55:40,979 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1197adada65eae2db55735ff4e977a96#family1#compaction#167 average throughput is 10.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-19 14:55:41,511 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113096285615a2d04a64a2a12855d9ac1884 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113096285615a2d04a64a2a12855d9ac1884 2023-03-19 14:55:41,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:55:41,530 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/.tmp/family1/034f14f2a80749f5b00324ae51e2e741 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/034f14f2a80749f5b00324ae51e2e741 2023-03-19 14:55:41,536 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1197adada65eae2db55735ff4e977a96/family1 of 1197adada65eae2db55735ff4e977a96 into 034f14f2a80749f5b00324ae51e2e741(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:41,536 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:41,536 INFO [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1679237740933; duration=0sec 2023-03-19 14:55:41,536 DEBUG [RS:0;jenkins-hbase20:33191-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-19 14:55:41,542 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8d1ee943cc2f4b4c90027833e9de6ad2 first=Optional[r00] last=Optional[r8] 2023-03-19 14:55:41,543 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8d1ee943cc2f4b4c90027833e9de6ad2}] 2023-03-19 14:55:41,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8d1ee943cc2f4b4c90027833e9de6ad2 for inclusion in 1197adada65eae2db55735ff4e977a96/family1 2023-03-19 14:55:41,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-19 14:55:41,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last= 2023-03-19 14:55:41,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:41,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8d1ee943cc2f4b4c90027833e9de6ad2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1b099hi2ds1i38olbnietoldfoopfp305ghu851vuvaroc4g2fqs5qm7n5rv43ju/family1/8d1ee943cc2f4b4c90027833e9de6ad2 2023-03-19 14:55:41,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1b099hi2ds1i38olbnietoldfoopfp305ghu851vuvaroc4g2fqs5qm7n5rv43ju/family1/8d1ee943cc2f4b4c90027833e9de6ad2 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/592b1917ca844d55a4be4db6d0e03cb2_SeqId_50_ 2023-03-19 14:55:41,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1b099hi2ds1i38olbnietoldfoopfp305ghu851vuvaroc4g2fqs5qm7n5rv43ju/family1/8d1ee943cc2f4b4c90027833e9de6ad2 into 1197adada65eae2db55735ff4e977a96/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/592b1917ca844d55a4be4db6d0e03cb2_SeqId_50_ - updating store file list. 2023-03-19 14:55:41,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/592b1917ca844d55a4be4db6d0e03cb2_SeqId_50_ into 1197adada65eae2db55735ff4e977a96/family1 2023-03-19 14:55:41,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1b099hi2ds1i38olbnietoldfoopfp305ghu851vuvaroc4g2fqs5qm7n5rv43ju/family1/8d1ee943cc2f4b4c90027833e9de6ad2 into 1197adada65eae2db55735ff4e977a96/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/592b1917ca844d55a4be4db6d0e03cb2_SeqId_50_) 2023-03-19 14:55:41,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMinorCompactionWithMonthlyPolicy__1b099hi2ds1i38olbnietoldfoopfp305ghu851vuvaroc4g2fqs5qm7n5rv43ju/family1/8d1ee943cc2f4b4c90027833e9de6ad2 2023-03-19 14:55:41,562 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:55:41,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/123e192d35e54dfb97132a0fae58e2c8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/ee5175ed19ab4cd3b36c6535a3fd31a3, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/b184a6dbf4604cf4a8a47f61f9a6ab38_SeqId_47_] to archive 2023-03-19 14:55:41,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:41,565 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:41,574 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c6394ce868074cfe8af1014d7329a129 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c6394ce868074cfe8af1014d7329a129 2023-03-19 14:55:41,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/123e192d35e54dfb97132a0fae58e2c8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/123e192d35e54dfb97132a0fae58e2c8 2023-03-19 14:55:41,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/ee5175ed19ab4cd3b36c6535a3fd31a3 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/ee5175ed19ab4cd3b36c6535a3fd31a3 2023-03-19 14:55:41,575 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288cffc03b95cb492699a1e75e6a17a949 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288cffc03b95cb492699a1e75e6a17a949 2023-03-19 14:55:41,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/b184a6dbf4604cf4a8a47f61f9a6ab38_SeqId_47_ to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/family1/b184a6dbf4604cf4a8a47f61f9a6ab38_SeqId_47_ 2023-03-19 14:55:41,578 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511305d66f36ca2c14b2c8c788d6523c57020 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511305d66f36ca2c14b2c8c788d6523c57020 2023-03-19 14:55:41,578 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-19 14:55:41,578 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-19 14:55:41,578 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:55:41,578 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:55:41,579 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-19 14:55:41,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-19 14:55:41,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:55:41,581 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-19 14:55:41,582 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2390 sec 2023-03-19 14:55:41,934 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=255 (was 254) - Thread LEAK? -, OpenFileDescriptor=636 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=249 (was 182) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=5006 (was 5448) 2023-03-19 14:55:41,952 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=255, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=249, ProcessCount=165, AvailableMemoryMB=5009 2023-03-19 14:55:41,978 DEBUG [Listener at localhost.localdomain/46521] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-19 14:55:42,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10vt\x1EC\x9E!}c\x96\xC1\xC5\x99kd\x1D\xC2"\x10K\x06p\xD6\xD7\x8C1'tO\xE9\xDE\x90_}\xC8*\x10V\x09\x064_\xE6\xDD\x14\xD5\xD4\xCE\x8C\x00\x07\xF7\xE52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-19 14:55:42,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-19 14:55:42,060 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-19 14:55:42,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-19 14:55:42,061 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-19 14:55:42,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-19 14:55:42,063 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:42,074 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421 empty. 2023-03-19 14:55:42,074 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:42,074 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:42,075 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:42,075 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74 empty. 2023-03-19 14:55:42,075 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750 empty. 2023-03-19 14:55:42,075 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:42,075 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:42,075 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-19 14:55:42,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-19 14:55:42,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-19 14:55:42,486 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-19 14:55:42,487 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2c6c932d1f65851da008e24e8b5d8421, NAME => 'testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10vt\x1EC\x9E!}c\x96\xC1\xC5\x99kd\x1D\xC2"\x10K\x06p\xD6\xD7\x8C1'tO\xE9\xDE\x90_}\xC8*\x10V\x09\x064_\xE6\xDD\x14\xD5\xD4\xCE\x8C\x00\x07\xF7\xE52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:55:42,487 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8109a875e9f73b5b519b5d4e5fb61c74, NAME => 'testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10vt\x1EC\x9E!}c\x96\xC1\xC5\x99kd\x1D\xC2"\x10K\x06p\xD6\xD7\x8C1'tO\xE9\xDE\x90_}\xC8*\x10V\x09\x064_\xE6\xDD\x14\xD5\xD4\xCE\x8C\x00\x07\xF7\xE52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:55:42,494 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1e58f793d571966c44e8ebe3a3e21750, NAME => 'testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10vt\x1EC\x9E!}c\x96\xC1\xC5\x99kd\x1D\xC2"\x10K\x06p\xD6\xD7\x8C1'tO\xE9\xDE\x90_}\xC8*\x10V\x09\x064_\xE6\xDD\x14\xD5\xD4\xCE\x8C\x00\x07\xF7\xE52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/.tmp 2023-03-19 14:55:42,562 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:42,562 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:42,563 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 2c6c932d1f65851da008e24e8b5d8421, disabling compactions & flushes 2023-03-19 14:55:42,563 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 1e58f793d571966c44e8ebe3a3e21750, disabling compactions & flushes 2023-03-19 14:55:42,563 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:42,563 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:42,563 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:42,563 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:42,563 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. after waiting 0 ms 2023-03-19 14:55:42,563 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. after waiting 0 ms 2023-03-19 14:55:42,563 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:42,563 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:42,563 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:42,563 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:42,563 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:42,563 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:42,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-19 14:55:42,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:42,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 8109a875e9f73b5b519b5d4e5fb61c74, disabling compactions & flushes 2023-03-19 14:55:42,963 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:42,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:42,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. after waiting 0 ms 2023-03-19 14:55:42,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:42,963 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:42,963 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:42,966 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-19 14:55:42,966 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237742966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237742966"}]},"ts":"1679237742966"} 2023-03-19 14:55:42,967 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237742966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237742966"}]},"ts":"1679237742966"} 2023-03-19 14:55:42,967 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679237742966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1679237742966"}]},"ts":"1679237742966"} 2023-03-19 14:55:42,969 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-19 14:55:42,970 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-19 14:55:42,970 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237742970"}]},"ts":"1679237742970"} 2023-03-19 14:55:42,971 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-19 14:55:42,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2c6c932d1f65851da008e24e8b5d8421, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8109a875e9f73b5b519b5d4e5fb61c74, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1e58f793d571966c44e8ebe3a3e21750, ASSIGN}] 2023-03-19 14:55:42,976 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8109a875e9f73b5b519b5d4e5fb61c74, ASSIGN 2023-03-19 14:55:42,976 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1e58f793d571966c44e8ebe3a3e21750, ASSIGN 2023-03-19 14:55:42,976 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2c6c932d1f65851da008e24e8b5d8421, ASSIGN 2023-03-19 14:55:42,976 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2c6c932d1f65851da008e24e8b5d8421, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:55:42,976 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1e58f793d571966c44e8ebe3a3e21750, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:55:42,976 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8109a875e9f73b5b519b5d4e5fb61c74, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,33191,1679237584457; forceNewPlan=false, retain=false 2023-03-19 14:55:43,129 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=8109a875e9f73b5b519b5d4e5fb61c74, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:43,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679237743129"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237743129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237743129"}]},"ts":"1679237743129"} 2023-03-19 14:55:43,129 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=1e58f793d571966c44e8ebe3a3e21750, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:43,129 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=2c6c932d1f65851da008e24e8b5d8421, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:43,129 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237743129"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237743129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237743129"}]},"ts":"1679237743129"} 2023-03-19 14:55:43,129 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237743129"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1679237743129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1679237743129"}]},"ts":"1679237743129"} 2023-03-19 14:55:43,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 8109a875e9f73b5b519b5d4e5fb61c74, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:43,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 1e58f793d571966c44e8ebe3a3e21750, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:43,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 2c6c932d1f65851da008e24e8b5d8421, server=jenkins-hbase20.apache.org,33191,1679237584457}] 2023-03-19 14:55:43,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-19 14:55:43,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:43,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8109a875e9f73b5b519b5d4e5fb61c74, NAME => 'testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74.', STARTKEY => '1', ENDKEY => '2'} 2023-03-19 14:55:43,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:43,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:43,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:43,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:43,321 INFO [StoreOpener-8109a875e9f73b5b519b5d4e5fb61c74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:43,323 DEBUG [StoreOpener-8109a875e9f73b5b519b5d4e5fb61c74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1 2023-03-19 14:55:43,323 DEBUG [StoreOpener-8109a875e9f73b5b519b5d4e5fb61c74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1 2023-03-19 14:55:43,323 INFO [StoreOpener-8109a875e9f73b5b519b5d4e5fb61c74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8109a875e9f73b5b519b5d4e5fb61c74 columnFamilyName family1 2023-03-19 14:55:43,324 INFO [StoreOpener-8109a875e9f73b5b519b5d4e5fb61c74-1] regionserver.HStore(310): Store=8109a875e9f73b5b519b5d4e5fb61c74/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:43,325 INFO [StoreOpener-8109a875e9f73b5b519b5d4e5fb61c74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:43,326 DEBUG [StoreOpener-8109a875e9f73b5b519b5d4e5fb61c74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2 2023-03-19 14:55:43,326 DEBUG [StoreOpener-8109a875e9f73b5b519b5d4e5fb61c74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2 2023-03-19 14:55:43,326 INFO [StoreOpener-8109a875e9f73b5b519b5d4e5fb61c74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8109a875e9f73b5b519b5d4e5fb61c74 columnFamilyName family2 2023-03-19 14:55:43,327 INFO [StoreOpener-8109a875e9f73b5b519b5d4e5fb61c74-1] regionserver.HStore(310): Store=8109a875e9f73b5b519b5d4e5fb61c74/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:43,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:43,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:43,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:55:43,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:43,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:55:43,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8109a875e9f73b5b519b5d4e5fb61c74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63135104, jitterRate=-0.05921363830566406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:55:43,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:43,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74., pid=120, masterSystemTime=1679237743284 2023-03-19 14:55:43,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:43,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:43,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:43,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e58f793d571966c44e8ebe3a3e21750, NAME => 'testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750.', STARTKEY => '2', ENDKEY => ''} 2023-03-19 14:55:43,338 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=8109a875e9f73b5b519b5d4e5fb61c74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:43,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:43,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:43,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:43,338 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1679237743337"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237743337"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237743337"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237743337"}]},"ts":"1679237743337"} 2023-03-19 14:55:43,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:43,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=118 2023-03-19 14:55:43,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 8109a875e9f73b5b519b5d4e5fb61c74, server=jenkins-hbase20.apache.org,33191,1679237584457 in 207 msec 2023-03-19 14:55:43,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8109a875e9f73b5b519b5d4e5fb61c74, ASSIGN in 367 msec 2023-03-19 14:55:43,365 INFO [StoreOpener-1e58f793d571966c44e8ebe3a3e21750-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:43,367 DEBUG [StoreOpener-1e58f793d571966c44e8ebe3a3e21750-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1 2023-03-19 14:55:43,367 DEBUG [StoreOpener-1e58f793d571966c44e8ebe3a3e21750-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1 2023-03-19 14:55:43,368 INFO [StoreOpener-1e58f793d571966c44e8ebe3a3e21750-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e58f793d571966c44e8ebe3a3e21750 columnFamilyName family1 2023-03-19 14:55:43,369 INFO [StoreOpener-1e58f793d571966c44e8ebe3a3e21750-1] regionserver.HStore(310): Store=1e58f793d571966c44e8ebe3a3e21750/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:43,369 INFO [StoreOpener-1e58f793d571966c44e8ebe3a3e21750-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:43,371 DEBUG [StoreOpener-1e58f793d571966c44e8ebe3a3e21750-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2 2023-03-19 14:55:43,371 DEBUG [StoreOpener-1e58f793d571966c44e8ebe3a3e21750-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2 2023-03-19 14:55:43,371 INFO [StoreOpener-1e58f793d571966c44e8ebe3a3e21750-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e58f793d571966c44e8ebe3a3e21750 columnFamilyName family2 2023-03-19 14:55:43,373 INFO [StoreOpener-1e58f793d571966c44e8ebe3a3e21750-1] regionserver.HStore(310): Store=1e58f793d571966c44e8ebe3a3e21750/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:43,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:43,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:43,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:55:43,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:43,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:55:43,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1e58f793d571966c44e8ebe3a3e21750; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66935234, jitterRate=-0.0025872886180877686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:55:43,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:43,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750., pid=121, masterSystemTime=1679237743284 2023-03-19 14:55:43,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:43,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:43,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:43,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2c6c932d1f65851da008e24e8b5d8421, NAME => 'testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421.', STARTKEY => '', ENDKEY => '1'} 2023-03-19 14:55:43,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=1e58f793d571966c44e8ebe3a3e21750, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:43,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237743385"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237743385"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237743385"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237743385"}]},"ts":"1679237743385"} 2023-03-19 14:55:43,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:43,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-19 14:55:43,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:43,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:43,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-03-19 14:55:43,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 1e58f793d571966c44e8ebe3a3e21750, server=jenkins-hbase20.apache.org,33191,1679237584457 in 256 msec 2023-03-19 14:55:43,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1e58f793d571966c44e8ebe3a3e21750, ASSIGN in 415 msec 2023-03-19 14:55:43,435 INFO [StoreOpener-2c6c932d1f65851da008e24e8b5d8421-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:43,439 DEBUG [StoreOpener-2c6c932d1f65851da008e24e8b5d8421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1 2023-03-19 14:55:43,439 DEBUG [StoreOpener-2c6c932d1f65851da008e24e8b5d8421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1 2023-03-19 14:55:43,439 INFO [StoreOpener-2c6c932d1f65851da008e24e8b5d8421-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c6c932d1f65851da008e24e8b5d8421 columnFamilyName family1 2023-03-19 14:55:43,440 INFO [StoreOpener-2c6c932d1f65851da008e24e8b5d8421-1] regionserver.HStore(310): Store=2c6c932d1f65851da008e24e8b5d8421/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:43,440 INFO [StoreOpener-2c6c932d1f65851da008e24e8b5d8421-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:43,441 DEBUG [StoreOpener-2c6c932d1f65851da008e24e8b5d8421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2 2023-03-19 14:55:43,441 DEBUG [StoreOpener-2c6c932d1f65851da008e24e8b5d8421-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2 2023-03-19 14:55:43,441 INFO [StoreOpener-2c6c932d1f65851da008e24e8b5d8421-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c6c932d1f65851da008e24e8b5d8421 columnFamilyName family2 2023-03-19 14:55:43,442 INFO [StoreOpener-2c6c932d1f65851da008e24e8b5d8421-1] regionserver.HStore(310): Store=2c6c932d1f65851da008e24e8b5d8421/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-19 14:55:43,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:43,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:43,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-19 14:55:43,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:43,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-19 14:55:43,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2c6c932d1f65851da008e24e8b5d8421; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61732467, jitterRate=-0.08011455833911896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-19 14:55:43,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:43,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421., pid=122, masterSystemTime=1679237743284 2023-03-19 14:55:43,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:43,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:43,449 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=2c6c932d1f65851da008e24e8b5d8421, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:43,449 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1679237743449"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1679237743449"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1679237743449"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1679237743449"}]},"ts":"1679237743449"} 2023-03-19 14:55:43,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-03-19 14:55:43,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 2c6c932d1f65851da008e24e8b5d8421, server=jenkins-hbase20.apache.org,33191,1679237584457 in 317 msec 2023-03-19 14:55:43,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-03-19 14:55:43,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2c6c932d1f65851da008e24e8b5d8421, ASSIGN in 479 msec 2023-03-19 14:55:43,455 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-19 14:55:43,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1679237743455"}]},"ts":"1679237743455"} 2023-03-19 14:55:43,457 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-19 14:55:43,459 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-19 14:55:43,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.4010 sec 2023-03-19 14:55:44,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-19 14:55:44,168 INFO [Listener at localhost.localdomain/46521] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-19 14:55:44,202 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:44,203 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:44,203 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:44,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:44,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-19 14:55:44,210 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-19 14:55:44,210 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:44,210 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-19 14:55:44,210 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-19 14:55:44,211 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:44,211 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:44,211 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:44,211 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:44,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:44,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:44,212 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:44,212 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:44,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:44,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:44,213 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-19 14:55:44,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-19 14:55:44,213 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-19 14:55:44,213 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:44,213 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-19 14:55:44,214 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:44,214 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. started... 2023-03-19 14:55:44,219 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8109a875e9f73b5b519b5d4e5fb61c74 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-19 14:55:44,219 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:44,219 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. started... 2023-03-19 14:55:44,234 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:55:44,234 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:44,239 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1e58f793d571966c44e8ebe3a3e21750 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-19 14:55:44,239 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:44,239 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. started... 2023-03-19 14:55:44,240 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2c6c932d1f65851da008e24e8b5d8421 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-19 14:55:44,332 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031927b262ba18554867af9f39b398fee1e8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031927b262ba18554867af9f39b398fee1e8 2023-03-19 14:55:44,355 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319cdc190b0542f4703867af6dd1a8658bc to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319cdc190b0542f4703867af6dd1a8658bc 2023-03-19 14:55:44,356 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/6ef1450911094ba39fcb7057eeef99d7 2023-03-19 14:55:44,726 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303194b526092ed4f4b80b51427eebafb15b1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303194b526092ed4f4b80b51427eebafb15b1 2023-03-19 14:55:44,779 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/54dcdbe2f0794b8f94b2247955d428a2 2023-03-19 14:55:44,797 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319005d6cbc886c40d5afabc3ebbfb65a9d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230319005d6cbc886c40d5afabc3ebbfb65a9d 2023-03-19 14:55:45,140 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/a4ea04b376f14f11b33bd4d36ef7d77c 2023-03-19 14:55:45,210 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/2f9a27e7e2be457e839649ac1702b200 2023-03-19 14:55:45,214 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/6ef1450911094ba39fcb7057eeef99d7 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/6ef1450911094ba39fcb7057eeef99d7 2023-03-19 14:55:45,221 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031979b837d483ae44cf8c3a7a8cb7b2c5ec to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023031979b837d483ae44cf8c3a7a8cb7b2c5ec 2023-03-19 14:55:45,225 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/044a7f82fa3e401582aa5bcce282d83a 2023-03-19 14:55:45,229 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/54dcdbe2f0794b8f94b2247955d428a2 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/54dcdbe2f0794b8f94b2247955d428a2 2023-03-19 14:55:45,246 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/6ef1450911094ba39fcb7057eeef99d7, entries=4, sequenceid=5, filesize=5.5 K 2023-03-19 14:55:45,247 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/2f9a27e7e2be457e839649ac1702b200 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/2f9a27e7e2be457e839649ac1702b200 2023-03-19 14:55:45,251 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/2f9a27e7e2be457e839649ac1702b200, entries=2, sequenceid=5, filesize=5.1 K 2023-03-19 14:55:45,252 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8109a875e9f73b5b519b5d4e5fb61c74 in 1033ms, sequenceid=5, compaction requested=false 2023-03-19 14:55:45,252 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-19 14:55:45,252 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:45,252 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:45,252 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:55:45,260 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/54dcdbe2f0794b8f94b2247955d428a2, entries=4, sequenceid=5, filesize=5.5 K 2023-03-19 14:55:45,261 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/044a7f82fa3e401582aa5bcce282d83a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/044a7f82fa3e401582aa5bcce282d83a 2023-03-19 14:55:45,266 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/044a7f82fa3e401582aa5bcce282d83a, entries=2, sequenceid=5, filesize=5.1 K 2023-03-19 14:55:45,267 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1e58f793d571966c44e8ebe3a3e21750 in 1029ms, sequenceid=5, compaction requested=false 2023-03-19 14:55:45,268 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:45,268 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:45,268 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:55:45,574 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031954d94eb16c5f4834b075fbf10b5a624d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023031954d94eb16c5f4834b075fbf10b5a624d 2023-03-19 14:55:45,978 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/862f8eb1caea407eb858aa61f8e9a2e4 2023-03-19 14:55:45,981 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/a4ea04b376f14f11b33bd4d36ef7d77c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/a4ea04b376f14f11b33bd4d36ef7d77c 2023-03-19 14:55:46,011 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/a4ea04b376f14f11b33bd4d36ef7d77c, entries=4, sequenceid=5, filesize=5.5 K 2023-03-19 14:55:46,012 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/862f8eb1caea407eb858aa61f8e9a2e4 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/862f8eb1caea407eb858aa61f8e9a2e4 2023-03-19 14:55:46,021 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/862f8eb1caea407eb858aa61f8e9a2e4, entries=2, sequenceid=5, filesize=5.1 K 2023-03-19 14:55:46,022 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2c6c932d1f65851da008e24e8b5d8421 in 1782ms, sequenceid=5, compaction requested=false 2023-03-19 14:55:46,022 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:46,022 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:46,022 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:55:46,022 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:55:46,022 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,022 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-19 14:55:46,022 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-19 14:55:46,023 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,023 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:46,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:46,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:46,024 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:46,024 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:46,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:46,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:46,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:46,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-19 14:55:46,025 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-19 14:55:46,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65679260[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:46,025 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:46,026 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:46,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:46,026 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-19 14:55:46,026 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-19 14:55:46,026 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:46,027 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,027 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:46,028 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:46,028 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-19 14:55:46,028 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:46,028 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-19 14:55:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:46,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:46,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:46,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:46,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:46,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-19 14:55:46,030 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-19 14:55:46,030 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:46,030 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:46,030 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-19 14:55:46,030 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:46,031 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:46,031 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:46,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:46,031 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:46,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:46,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:46,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:46,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:46,032 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:46,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:46,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:46,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:46,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,033 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:46,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:46,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:46,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:46,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-19 14:55:46,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:46,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:46,035 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:46,035 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:46,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:46,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:46,135 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:46,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:46,137 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:46,137 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:46,137 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:46,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:46,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:46,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-19 14:55:46,141 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-19 14:55:46,141 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:46,141 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-19 14:55:46,141 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-19 14:55:46,141 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:46,141 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:46,142 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,142 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:46,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:46,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:46,142 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:46,142 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:46,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:46,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:46,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:46,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:46,143 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-19 14:55:46,143 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-19 14:55:46,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-19 14:55:46,144 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-19 14:55:46,144 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:46,144 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-19 14:55:46,144 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:46,144 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:55:46,144 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:46,144 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. started... 2023-03-19 14:55:46,144 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:46,144 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:46,144 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. started... 2023-03-19 14:55:46,144 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. started... 2023-03-19 14:55:46,144 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8109a875e9f73b5b519b5d4e5fb61c74 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-19 14:55:46,144 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2c6c932d1f65851da008e24e8b5d8421 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-19 14:55:46,144 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1e58f793d571966c44e8ebe3a3e21750 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-19 14:55:46,220 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319778602f300a347c3986a4db3faf74f07 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319778602f300a347c3986a4db3faf74f07 2023-03-19 14:55:46,230 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031924ab3cf22c1a427fa968dc4ad015b5c6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031924ab3cf22c1a427fa968dc4ad015b5c6 2023-03-19 14:55:46,236 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319583c5ccbd01a44eb966ffeb6fabe32fd to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230319583c5ccbd01a44eb966ffeb6fabe32fd 2023-03-19 14:55:46,244 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/659b241e9653493dbfef58e5a949e8d8 2023-03-19 14:55:46,253 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/b1b2027f758443949e5a353a83b9ce44 2023-03-19 14:55:46,259 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/551ff76c5c1b4156a5eab43d79fa7da2 2023-03-19 14:55:46,327 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319df2cd18cdd7747339d1ea031b0ce10fe to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230319df2cd18cdd7747339d1ea031b0ce10fe 2023-03-19 14:55:46,356 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303199b23df1813644f468ab9117788eb7055 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303199b23df1813644f468ab9117788eb7055 2023-03-19 14:55:46,707 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319cf946cadfd5847b9a2987bae1722d96d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230319cf946cadfd5847b9a2987bae1722d96d 2023-03-19 14:55:46,750 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/d25a9d99c7fe4c329896b97574a64f13 2023-03-19 14:55:46,754 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/659b241e9653493dbfef58e5a949e8d8 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/659b241e9653493dbfef58e5a949e8d8 2023-03-19 14:55:46,763 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/315b108394814af28a1a6c55d70f0c6c 2023-03-19 14:55:46,768 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/551ff76c5c1b4156a5eab43d79fa7da2 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/551ff76c5c1b4156a5eab43d79fa7da2 2023-03-19 14:55:46,783 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/659b241e9653493dbfef58e5a949e8d8, entries=4, sequenceid=9, filesize=5.5 K 2023-03-19 14:55:46,789 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/d25a9d99c7fe4c329896b97574a64f13 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/d25a9d99c7fe4c329896b97574a64f13 2023-03-19 14:55:46,795 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/d25a9d99c7fe4c329896b97574a64f13, entries=2, sequenceid=9, filesize=5.1 K 2023-03-19 14:55:46,797 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1e58f793d571966c44e8ebe3a3e21750 in 652ms, sequenceid=9, compaction requested=false 2023-03-19 14:55:46,797 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:46,797 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:46,797 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:55:46,799 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/551ff76c5c1b4156a5eab43d79fa7da2, entries=4, sequenceid=9, filesize=5.5 K 2023-03-19 14:55:46,799 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/315b108394814af28a1a6c55d70f0c6c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/315b108394814af28a1a6c55d70f0c6c 2023-03-19 14:55:46,806 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/315b108394814af28a1a6c55d70f0c6c, entries=2, sequenceid=9, filesize=5.1 K 2023-03-19 14:55:46,808 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8109a875e9f73b5b519b5d4e5fb61c74 in 664ms, sequenceid=9, compaction requested=false 2023-03-19 14:55:46,808 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:46,808 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:46,808 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:55:47,116 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/ed11d64d630c40979a66d7ba88bfdca9 2023-03-19 14:55:47,119 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/b1b2027f758443949e5a353a83b9ce44 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/b1b2027f758443949e5a353a83b9ce44 2023-03-19 14:55:47,147 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/b1b2027f758443949e5a353a83b9ce44, entries=4, sequenceid=9, filesize=5.5 K 2023-03-19 14:55:47,148 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/ed11d64d630c40979a66d7ba88bfdca9 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/ed11d64d630c40979a66d7ba88bfdca9 2023-03-19 14:55:47,151 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/ed11d64d630c40979a66d7ba88bfdca9, entries=2, sequenceid=9, filesize=5.1 K 2023-03-19 14:55:47,152 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2c6c932d1f65851da008e24e8b5d8421 in 1008ms, sequenceid=9, compaction requested=false 2023-03-19 14:55:47,152 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:47,152 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:47,152 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:55:47,152 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:55:47,152 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,152 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-19 14:55:47,152 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-19 14:55:47,153 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,153 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:47,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:47,153 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:47,154 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:47,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-19 14:55:47,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773f3b13[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:47,154 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-19 14:55:47,155 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:47,155 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:47,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:47,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:47,155 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-19 14:55:47,155 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-19 14:55:47,155 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:47,155 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,155 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:47,156 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-19 14:55:47,156 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,156 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:47,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:47,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:47,156 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-19 14:55:47,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:47,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:47,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:47,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:47,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:47,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-19 14:55:47,159 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-19 14:55:47,159 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:47,159 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:47,159 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-19 14:55:47,159 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:47,160 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:47,160 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:47,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:47,160 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:47,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:47,161 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:47,162 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:47,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,163 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:47,163 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:47,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:47,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:47,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-19 14:55:47,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-19 14:55:47,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:47,164 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:47,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:47,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:47,164 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:47,164 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:47,165 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,165 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:47,165 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:47,165 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,165 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:47,165 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:47,165 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:47,264 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:47,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:47,265 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:47,266 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:47,266 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:47,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:47,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:47,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-19 14:55:47,286 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-19 14:55:47,286 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:47,286 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-19 14:55:47,286 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-19 14:55:47,286 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:47,287 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:47,287 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:47,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:47,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:47,288 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:47,288 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-19 14:55:47,288 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:47,289 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-19 14:55:47,289 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:47,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-19 14:55:47,289 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-19 14:55:47,289 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:47,289 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-19 14:55:47,289 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:47,289 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. started... 2023-03-19 14:55:47,289 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8109a875e9f73b5b519b5d4e5fb61c74 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-19 14:55:47,290 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:47,290 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. started... 2023-03-19 14:55:47,290 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1e58f793d571966c44e8ebe3a3e21750 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-19 14:55:47,298 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:55:47,298 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:47,298 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:47,298 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. started... 2023-03-19 14:55:47,299 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2c6c932d1f65851da008e24e8b5d8421 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-19 14:55:47,396 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031967d2fd61a9a4474eb5e0ded1c581d839 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031967d2fd61a9a4474eb5e0ded1c581d839 2023-03-19 14:55:47,432 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/1e15d32a6dea414aa10fcb25ea283236 2023-03-19 14:55:47,443 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031930eea9dfda7e4487a9f26147f5855fa8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031930eea9dfda7e4487a9f26147f5855fa8 2023-03-19 14:55:47,468 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/73d7c00657894a208baf694a67139676 2023-03-19 14:55:47,788 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031981275cbc895e45798d72dfcec06ecc03 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023031981275cbc895e45798d72dfcec06ecc03 2023-03-19 14:55:47,820 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/79b1d798b0da4587ba4b074b2c305aa7 2023-03-19 14:55:47,878 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319490e8e69221c42a7962fe1c32a4a9096 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230319490e8e69221c42a7962fe1c32a4a9096 2023-03-19 14:55:47,883 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/6410f9dd59224d6fbfb92d65326e165d 2023-03-19 14:55:47,888 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/1e15d32a6dea414aa10fcb25ea283236 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/1e15d32a6dea414aa10fcb25ea283236 2023-03-19 14:55:47,918 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/1e15d32a6dea414aa10fcb25ea283236, entries=4, sequenceid=13, filesize=5.5 K 2023-03-19 14:55:47,919 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/6410f9dd59224d6fbfb92d65326e165d as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/6410f9dd59224d6fbfb92d65326e165d 2023-03-19 14:55:47,922 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/6410f9dd59224d6fbfb92d65326e165d, entries=2, sequenceid=13, filesize=5.1 K 2023-03-19 14:55:47,923 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1e58f793d571966c44e8ebe3a3e21750 in 633ms, sequenceid=13, compaction requested=true 2023-03-19 14:55:47,923 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:47,923 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:47,923 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:55:47,967 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319639eba0afb194457b1cfcec4ad9678c3 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230319639eba0afb194457b1cfcec4ad9678c3 2023-03-19 14:55:47,970 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/922b9a33af3044fab1380d3b709924cd 2023-03-19 14:55:47,973 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/73d7c00657894a208baf694a67139676 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/73d7c00657894a208baf694a67139676 2023-03-19 14:55:47,998 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/73d7c00657894a208baf694a67139676, entries=4, sequenceid=13, filesize=5.5 K 2023-03-19 14:55:48,017 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/922b9a33af3044fab1380d3b709924cd as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/922b9a33af3044fab1380d3b709924cd 2023-03-19 14:55:48,022 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/922b9a33af3044fab1380d3b709924cd, entries=2, sequenceid=13, filesize=5.1 K 2023-03-19 14:55:48,023 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8109a875e9f73b5b519b5d4e5fb61c74 in 734ms, sequenceid=13, compaction requested=true 2023-03-19 14:55:48,023 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:48,023 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:48,023 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:55:48,293 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319173c81153ff24ecf8b92799368463243 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230319173c81153ff24ecf8b92799368463243 2023-03-19 14:55:48,324 WARN [DataStreamer for file /user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/7acf85be425743ba9bc1875c54e00d31] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-03-19 14:55:48,324 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/7acf85be425743ba9bc1875c54e00d31 2023-03-19 14:55:48,330 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/79b1d798b0da4587ba4b074b2c305aa7 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/79b1d798b0da4587ba4b074b2c305aa7 2023-03-19 14:55:48,360 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/79b1d798b0da4587ba4b074b2c305aa7, entries=4, sequenceid=13, filesize=5.5 K 2023-03-19 14:55:48,361 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/7acf85be425743ba9bc1875c54e00d31 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/7acf85be425743ba9bc1875c54e00d31 2023-03-19 14:55:48,364 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/7acf85be425743ba9bc1875c54e00d31, entries=2, sequenceid=13, filesize=5.1 K 2023-03-19 14:55:48,365 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2c6c932d1f65851da008e24e8b5d8421 in 1066ms, sequenceid=13, compaction requested=true 2023-03-19 14:55:48,365 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:48,365 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:48,365 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:55:48,365 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:55:48,365 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,365 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-19 14:55:48,365 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-19 14:55:48,366 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,366 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:48,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:48,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:48,367 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:48,367 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:48,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:48,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:48,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:48,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:48,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-19 14:55:48,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fe0bb80[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:48,368 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-19 14:55:48,368 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:48,369 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:48,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:48,369 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-19 14:55:48,369 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-19 14:55:48,369 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:48,369 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,369 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:48,370 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:48,370 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-19 14:55:48,370 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:48,370 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-19 14:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:48,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-19 14:55:48,372 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-19 14:55:48,372 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:48,372 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:48,372 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-19 14:55:48,372 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:48,373 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:48,373 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:48,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:48,373 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:48,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:48,373 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,375 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:48,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:48,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:48,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:48,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-19 14:55:48,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:48,377 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:48,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:48,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:48,377 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:48,478 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:48,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:48,479 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:48,479 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:48,480 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. with WAL disabled. Data may be lost in the event of a crash. 2023-03-19 14:55:48,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:48,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:48,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-19 14:55:48,482 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-19 14:55:48,483 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:48,483 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-19 14:55:48,483 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-19 14:55:48,483 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:48,483 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:48,483 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:48,483 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:48,484 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:48,484 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:48,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:48,484 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-19 14:55:48,484 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-19 14:55:48,484 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-19 14:55:48,484 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-19 14:55:48,484 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:48,485 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-19 14:55:48,485 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:48,485 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. started... 2023-03-19 14:55:48,485 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:48,485 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:48,485 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8109a875e9f73b5b519b5d4e5fb61c74 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-19 14:55:48,485 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:55:48,485 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:48,485 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. started... 2023-03-19 14:55:48,485 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. started... 2023-03-19 14:55:48,485 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2c6c932d1f65851da008e24e8b5d8421 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-19 14:55:48,485 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1e58f793d571966c44e8ebe3a3e21750 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-19 14:55:48,528 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303198bd51f5b1aeb4555b2f67a41452c980a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303198bd51f5b1aeb4555b2f67a41452c980a 2023-03-19 14:55:48,539 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303197d69a38ac5f8465997fa02c3c0f96afa to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303197d69a38ac5f8465997fa02c3c0f96afa 2023-03-19 14:55:48,540 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319c53640cd882e4760b956e42158633be0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230319c53640cd882e4760b956e42158633be0 2023-03-19 14:55:48,577 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/03cbe734c1144e3d806946b2ad2a0068 2023-03-19 14:55:48,580 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/9063604a3da9490ca77853d3505bbeb8 2023-03-19 14:55:48,636 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319d4d4292df20f41d283fb91d0e155118c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230319d4d4292df20f41d283fb91d0e155118c 2023-03-19 14:55:48,643 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/3337b4abd5a448dbb05a336e2c2c096f 2023-03-19 14:55:48,644 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303197e4e58cccd4e40a894d3023cf9f7e530 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303197e4e58cccd4e40a894d3023cf9f7e530 2023-03-19 14:55:48,646 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/9063604a3da9490ca77853d3505bbeb8 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/9063604a3da9490ca77853d3505bbeb8 2023-03-19 14:55:48,670 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/9063604a3da9490ca77853d3505bbeb8, entries=4, sequenceid=17, filesize=5.5 K 2023-03-19 14:55:48,670 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/3337b4abd5a448dbb05a336e2c2c096f as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/3337b4abd5a448dbb05a336e2c2c096f 2023-03-19 14:55:48,673 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/3337b4abd5a448dbb05a336e2c2c096f, entries=2, sequenceid=17, filesize=5.1 K 2023-03-19 14:55:48,674 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8109a875e9f73b5b519b5d4e5fb61c74 in 189ms, sequenceid=17, compaction requested=true 2023-03-19 14:55:48,674 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:48,674 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:48,674 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:55:48,842 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-19 14:55:48,980 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/086b15b462be467ebda7402d5ec7b8f5 2023-03-19 14:55:49,045 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319788f23a04cf9468a9126a46a10db7db0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230319788f23a04cf9468a9126a46a10db7db0 2023-03-19 14:55:49,063 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/f3666f1d62be4891bbcf342993725a9a 2023-03-19 14:55:49,068 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/03cbe734c1144e3d806946b2ad2a0068 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/03cbe734c1144e3d806946b2ad2a0068 2023-03-19 14:55:49,102 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/03cbe734c1144e3d806946b2ad2a0068, entries=4, sequenceid=17, filesize=5.5 K 2023-03-19 14:55:49,103 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/f3666f1d62be4891bbcf342993725a9a as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/f3666f1d62be4891bbcf342993725a9a 2023-03-19 14:55:49,119 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/f3666f1d62be4891bbcf342993725a9a, entries=2, sequenceid=17, filesize=5.1 K 2023-03-19 14:55:49,120 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1e58f793d571966c44e8ebe3a3e21750 in 635ms, sequenceid=17, compaction requested=true 2023-03-19 14:55:49,120 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:49,120 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:49,120 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:55:49,450 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/b90041b9d7cc412e815da26ffd31c4cc 2023-03-19 14:55:49,454 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/086b15b462be467ebda7402d5ec7b8f5 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/086b15b462be467ebda7402d5ec7b8f5 2023-03-19 14:55:49,477 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/086b15b462be467ebda7402d5ec7b8f5, entries=4, sequenceid=17, filesize=5.5 K 2023-03-19 14:55:49,478 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/b90041b9d7cc412e815da26ffd31c4cc as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/b90041b9d7cc412e815da26ffd31c4cc 2023-03-19 14:55:49,482 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/b90041b9d7cc412e815da26ffd31c4cc, entries=2, sequenceid=17, filesize=5.1 K 2023-03-19 14:55:49,483 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2c6c932d1f65851da008e24e8b5d8421 in 998ms, sequenceid=17, compaction requested=true 2023-03-19 14:55:49,483 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:49,483 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:49,483 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:55:49,483 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:55:49,483 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,483 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-19 14:55:49,483 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-19 14:55:49,484 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:49,484 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:49,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:49,484 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:49,484 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:49,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:49,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:49,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:49,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:49,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-19 14:55:49,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57ae3f0d[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:49,485 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-19 14:55:49,485 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:49,486 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:49,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:49,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:49,486 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-19 14:55:49,486 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-19 14:55:49,486 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:49,487 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,487 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:49,487 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:49,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:49,487 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-19 14:55:49,487 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:49,487 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-19 14:55:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:49,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-19 14:55:49,489 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-19 14:55:49,489 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:49,489 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:49,489 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-19 14:55:49,489 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:49,490 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:49,490 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:49,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:49,490 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:49,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:49,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:49,491 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:49,492 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,493 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,493 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:49,493 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:49,493 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:49,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:49,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:49,493 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:49,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-19 14:55:49,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:49,493 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:49,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-19 14:55:49,493 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,494 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:49,494 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:49,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:49,494 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:49,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:49,494 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:49,494 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:49,594 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:49,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:49,602 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:49,609 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:49,615 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:49,616 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:49,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-19 14:55:49,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-19 14:55:49,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-19 14:55:49,713 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-19 14:55:49,713 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:49,713 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-19 14:55:49,713 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-19 14:55:49,713 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:49,713 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:49,714 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:49,714 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:49,714 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:49,714 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-19 14:55:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:49,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:49,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-19 14:55:49,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:49,715 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-19 14:55:49,715 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-19 14:55:49,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-19 14:55:49,715 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-19 14:55:49,715 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-19 14:55:49,715 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-19 14:55:49,715 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:49,715 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. started... 2023-03-19 14:55:49,715 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8109a875e9f73b5b519b5d4e5fb61c74 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-19 14:55:49,716 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:49,716 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-19 14:55:49,716 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-19 14:55:49,716 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:49,716 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. started... 2023-03-19 14:55:49,716 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2c6c932d1f65851da008e24e8b5d8421 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-19 14:55:49,716 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. started... 2023-03-19 14:55:49,716 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 1e58f793d571966c44e8ebe3a3e21750 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-19 14:55:49,763 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/93970f5568024a829a2f978b87bc769e 2023-03-19 14:55:49,785 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93970f5568024a829a2f978b87bc769e 2023-03-19 14:55:50,176 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/120409ffa6bb400bb39b0bef90e5b695 2023-03-19 14:55:50,196 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 120409ffa6bb400bb39b0bef90e5b695 2023-03-19 14:55:50,563 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/3807c134e3ee4e4491d665b08b4bedec 2023-03-19 14:55:50,590 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3807c134e3ee4e4491d665b08b4bedec 2023-03-19 14:55:50,595 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/b447d3c89e714e6fbd638feb417bfea6 2023-03-19 14:55:50,597 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b447d3c89e714e6fbd638feb417bfea6 2023-03-19 14:55:50,598 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/93970f5568024a829a2f978b87bc769e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/93970f5568024a829a2f978b87bc769e 2023-03-19 14:55:50,626 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93970f5568024a829a2f978b87bc769e 2023-03-19 14:55:50,626 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/93970f5568024a829a2f978b87bc769e, entries=3, sequenceid=23, filesize=5.2 K 2023-03-19 14:55:50,627 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/b447d3c89e714e6fbd638feb417bfea6 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/b447d3c89e714e6fbd638feb417bfea6 2023-03-19 14:55:50,631 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b447d3c89e714e6fbd638feb417bfea6 2023-03-19 14:55:50,631 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/b447d3c89e714e6fbd638feb417bfea6, entries=1, sequenceid=23, filesize=5.0 K 2023-03-19 14:55:50,632 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8109a875e9f73b5b519b5d4e5fb61c74 in 917ms, sequenceid=23, compaction requested=true 2023-03-19 14:55:50,632 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:50,632 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:50,632 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-19 14:55:51,012 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/17303dcef81143418b29569f623518b5 2023-03-19 14:55:51,015 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17303dcef81143418b29569f623518b5 2023-03-19 14:55:51,016 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/120409ffa6bb400bb39b0bef90e5b695 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/120409ffa6bb400bb39b0bef90e5b695 2023-03-19 14:55:51,037 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 120409ffa6bb400bb39b0bef90e5b695 2023-03-19 14:55:51,037 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/120409ffa6bb400bb39b0bef90e5b695, entries=3, sequenceid=23, filesize=5.2 K 2023-03-19 14:55:51,038 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/17303dcef81143418b29569f623518b5 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/17303dcef81143418b29569f623518b5 2023-03-19 14:55:51,042 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 17303dcef81143418b29569f623518b5 2023-03-19 14:55:51,042 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/17303dcef81143418b29569f623518b5, entries=1, sequenceid=23, filesize=5.0 K 2023-03-19 14:55:51,043 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1e58f793d571966c44e8ebe3a3e21750 in 1326ms, sequenceid=23, compaction requested=true 2023-03-19 14:55:51,043 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:51,043 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:51,043 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-19 14:55:51,400 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/c2ef65b364c84ac9aeb0f5887e0ab81c 2023-03-19 14:55:51,403 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2ef65b364c84ac9aeb0f5887e0ab81c 2023-03-19 14:55:51,404 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/3807c134e3ee4e4491d665b08b4bedec as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/3807c134e3ee4e4491d665b08b4bedec 2023-03-19 14:55:51,424 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3807c134e3ee4e4491d665b08b4bedec 2023-03-19 14:55:51,425 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/3807c134e3ee4e4491d665b08b4bedec, entries=3, sequenceid=23, filesize=5.2 K 2023-03-19 14:55:51,425 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/c2ef65b364c84ac9aeb0f5887e0ab81c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/c2ef65b364c84ac9aeb0f5887e0ab81c 2023-03-19 14:55:51,429 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c2ef65b364c84ac9aeb0f5887e0ab81c 2023-03-19 14:55:51,429 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/c2ef65b364c84ac9aeb0f5887e0ab81c, entries=1, sequenceid=23, filesize=5.0 K 2023-03-19 14:55:51,430 INFO [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2c6c932d1f65851da008e24e8b5d8421 in 1714ms, sequenceid=23, compaction requested=true 2023-03-19 14:55:51,430 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:51,430 DEBUG [rs(jenkins-hbase20.apache.org,33191,1679237584457)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:51,430 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-19 14:55:51,430 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-19 14:55:51,430 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,430 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-19 14:55:51,430 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-19 14:55:51,431 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,431 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:51,432 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:51,432 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-19 14:55:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:51,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,33191,1679237584457' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-19 14:55:51,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e03430a[Count = 0] remaining members to acquire global barrier 2023-03-19 14:55:51,432 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-19 14:55:51,433 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:51,433 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:51,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:51,433 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-19 14:55:51,433 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-19 14:55:51,433 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,433 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-19 14:55:51,433 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,33191,1679237584457' in zk 2023-03-19 14:55:51,434 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-19 14:55:51,434 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,434 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:51,434 DEBUG [member: 'jenkins-hbase20.apache.org,33191,1679237584457' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-19 14:55:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,33191,1679237584457': 2023-03-19 14:55:51,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,33191,1679237584457' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-19 14:55:51,436 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-19 14:55:51,436 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-19 14:55:51,436 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-19 14:55:51,436 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-19 14:55:51,436 INFO [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-19 14:55:51,436 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:51,436 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:51,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:51,437 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-19 14:55:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-19 14:55:51,437 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-19 14:55:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-19 14:55:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:51,438 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-19 14:55:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-19 14:55:51,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:51,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-19 14:55:51,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:51,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-19 14:55:51,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-19 14:55:51,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-19 14:55:51,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-19 14:55:51,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:51,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-19 14:55:51,439 DEBUG [(jenkins-hbase20.apache.org,35187,1679237583319)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-19 14:55:51,439 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-19 14:55:51,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-19 14:55:51,439 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-19 14:55:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-19 14:55:51,440 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-19 14:55:51,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-19 14:55:51,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-19 14:55:51,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-19 14:55:51,540 DEBUG [Listener at localhost.localdomain/46521] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-19 14:55:51,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35187] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-19 14:55:51,541 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:51,541 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): 8109a875e9f73b5b519b5d4e5fb61c74/family1 is initiating major compaction (all files) 2023-03-19 14:55:51,541 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:51,541 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:51,541 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of 8109a875e9f73b5b519b5d4e5fb61c74/family1 in testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:51,541 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/6ef1450911094ba39fcb7057eeef99d7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/551ff76c5c1b4156a5eab43d79fa7da2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/73d7c00657894a208baf694a67139676, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/9063604a3da9490ca77853d3505bbeb8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/93970f5568024a829a2f978b87bc769e] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp, totalSize=27.1 K 2023-03-19 14:55:51,542 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 6ef1450911094ba39fcb7057eeef99d7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237744203 2023-03-19 14:55:51,542 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 551ff76c5c1b4156a5eab43d79fa7da2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237746137 2023-03-19 14:55:51,542 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 73d7c00657894a208baf694a67139676, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237747266 2023-03-19 14:55:51,543 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 9063604a3da9490ca77853d3505bbeb8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237748479 2023-03-19 14:55:51,543 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 93970f5568024a829a2f978b87bc769e, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:51,551 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): 8109a875e9f73b5b519b5d4e5fb61c74#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:51,588 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230319711163452e914809980aa6a0396cc1e2_del 2023-03-19 14:55:51,588 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319711163452e914809980aa6a0396cc1e2_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230319711163452e914809980aa6a0396cc1e2_del 2023-03-19 14:55:51,642 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bcdd7d68bc594e6e9d01f1aa0f7e7c72 2023-03-19 14:55:51,643 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family1/bcdd7d68bc594e6e9d01f1aa0f7e7c72 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/bcdd7d68bc594e6e9d01f1aa0f7e7c72 2023-03-19 14:55:51,673 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bcdd7d68bc594e6e9d01f1aa0f7e7c72 2023-03-19 14:55:51,674 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8109a875e9f73b5b519b5d4e5fb61c74/family1 of 8109a875e9f73b5b519b5d4e5fb61c74 into bcdd7d68bc594e6e9d01f1aa0f7e7c72(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:51,675 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:51,675 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:51,675 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): 8109a875e9f73b5b519b5d4e5fb61c74/family2 is initiating major compaction (all files) 2023-03-19 14:55:51,675 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:51,675 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:51,676 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of 8109a875e9f73b5b519b5d4e5fb61c74/family2 in testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:51,676 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/2f9a27e7e2be457e839649ac1702b200, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/315b108394814af28a1a6c55d70f0c6c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/922b9a33af3044fab1380d3b709924cd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/3337b4abd5a448dbb05a336e2c2c096f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/b447d3c89e714e6fbd638feb417bfea6] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp, totalSize=25.4 K 2023-03-19 14:55:51,677 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 2f9a27e7e2be457e839649ac1702b200, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237744203 2023-03-19 14:55:51,677 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 315b108394814af28a1a6c55d70f0c6c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237746137 2023-03-19 14:55:51,677 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 922b9a33af3044fab1380d3b709924cd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237747266 2023-03-19 14:55:51,678 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 3337b4abd5a448dbb05a336e2c2c096f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237748479 2023-03-19 14:55:51,678 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting b447d3c89e714e6fbd638feb417bfea6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:51,684 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): 8109a875e9f73b5b519b5d4e5fb61c74#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:51,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/6ef1450911094ba39fcb7057eeef99d7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/551ff76c5c1b4156a5eab43d79fa7da2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/73d7c00657894a208baf694a67139676, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/9063604a3da9490ca77853d3505bbeb8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/93970f5568024a829a2f978b87bc769e] to archive 2023-03-19 14:55:51,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:51,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/6ef1450911094ba39fcb7057eeef99d7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/6ef1450911094ba39fcb7057eeef99d7 2023-03-19 14:55:51,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/551ff76c5c1b4156a5eab43d79fa7da2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/551ff76c5c1b4156a5eab43d79fa7da2 2023-03-19 14:55:51,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/73d7c00657894a208baf694a67139676 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/73d7c00657894a208baf694a67139676 2023-03-19 14:55:51,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/9063604a3da9490ca77853d3505bbeb8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/9063604a3da9490ca77853d3505bbeb8 2023-03-19 14:55:51,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/93970f5568024a829a2f978b87bc769e to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/93970f5568024a829a2f978b87bc769e 2023-03-19 14:55:52,091 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230319fa0535dc47484d6e87a9ef1b6d7b7bb0_del 2023-03-19 14:55:52,091 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230319fa0535dc47484d6e87a9ef1b6d7b7bb0_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230319fa0535dc47484d6e87a9ef1b6d7b7bb0_del 2023-03-19 14:55:52,904 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83af463ad37b452594dd20271adf193e 2023-03-19 14:55:52,905 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/.tmp/family2/83af463ad37b452594dd20271adf193e as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/83af463ad37b452594dd20271adf193e 2023-03-19 14:55:52,915 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83af463ad37b452594dd20271adf193e 2023-03-19 14:55:52,916 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8109a875e9f73b5b519b5d4e5fb61c74/family2 of 8109a875e9f73b5b519b5d4e5fb61c74 into 83af463ad37b452594dd20271adf193e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-19 14:55:52,916 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:52,916 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:52,916 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): 1e58f793d571966c44e8ebe3a3e21750/family1 is initiating major compaction (all files) 2023-03-19 14:55:52,917 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:52,917 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:52,919 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of 1e58f793d571966c44e8ebe3a3e21750/family1 in testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:52,919 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/54dcdbe2f0794b8f94b2247955d428a2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/659b241e9653493dbfef58e5a949e8d8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/1e15d32a6dea414aa10fcb25ea283236, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/03cbe734c1144e3d806946b2ad2a0068, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/120409ffa6bb400bb39b0bef90e5b695] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp, totalSize=27.1 K 2023-03-19 14:55:52,922 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 54dcdbe2f0794b8f94b2247955d428a2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237744203 2023-03-19 14:55:52,922 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 659b241e9653493dbfef58e5a949e8d8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237746137 2023-03-19 14:55:52,922 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 1e15d32a6dea414aa10fcb25ea283236, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237747266 2023-03-19 14:55:52,923 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 03cbe734c1144e3d806946b2ad2a0068, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237748480 2023-03-19 14:55:52,923 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 120409ffa6bb400bb39b0bef90e5b695, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:52,949 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): 1e58f793d571966c44e8ebe3a3e21750#family1#compaction#200 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:52,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/2f9a27e7e2be457e839649ac1702b200, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/315b108394814af28a1a6c55d70f0c6c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/922b9a33af3044fab1380d3b709924cd, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/3337b4abd5a448dbb05a336e2c2c096f, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/b447d3c89e714e6fbd638feb417bfea6] to archive 2023-03-19 14:55:52,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:52,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/2f9a27e7e2be457e839649ac1702b200 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/2f9a27e7e2be457e839649ac1702b200 2023-03-19 14:55:52,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/315b108394814af28a1a6c55d70f0c6c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/315b108394814af28a1a6c55d70f0c6c 2023-03-19 14:55:52,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/922b9a33af3044fab1380d3b709924cd to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/922b9a33af3044fab1380d3b709924cd 2023-03-19 14:55:52,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/3337b4abd5a448dbb05a336e2c2c096f to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/3337b4abd5a448dbb05a336e2c2c096f 2023-03-19 14:55:52,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/b447d3c89e714e6fbd638feb417bfea6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family2/b447d3c89e714e6fbd638feb417bfea6 2023-03-19 14:55:53,035 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230319a01abac3ec99496096d91cde833be6be_del 2023-03-19 14:55:53,035 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319a01abac3ec99496096d91cde833be6be_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319a01abac3ec99496096d91cde833be6be_del 2023-03-19 14:55:53,518 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d3f68a9440b4d5daaef986fdee5fbbe 2023-03-19 14:55:53,522 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family1/7d3f68a9440b4d5daaef986fdee5fbbe as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/7d3f68a9440b4d5daaef986fdee5fbbe 2023-03-19 14:55:53,552 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d3f68a9440b4d5daaef986fdee5fbbe 2023-03-19 14:55:53,554 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1e58f793d571966c44e8ebe3a3e21750/family1 of 1e58f793d571966c44e8ebe3a3e21750 into 7d3f68a9440b4d5daaef986fdee5fbbe(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:53,554 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:53,554 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:53,555 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): 1e58f793d571966c44e8ebe3a3e21750/family2 is initiating major compaction (all files) 2023-03-19 14:55:53,555 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:53,555 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:53,555 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of 1e58f793d571966c44e8ebe3a3e21750/family2 in testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:53,555 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/044a7f82fa3e401582aa5bcce282d83a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/d25a9d99c7fe4c329896b97574a64f13, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/6410f9dd59224d6fbfb92d65326e165d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/f3666f1d62be4891bbcf342993725a9a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/17303dcef81143418b29569f623518b5] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp, totalSize=25.4 K 2023-03-19 14:55:53,556 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 044a7f82fa3e401582aa5bcce282d83a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237744203 2023-03-19 14:55:53,556 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting d25a9d99c7fe4c329896b97574a64f13, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237746137 2023-03-19 14:55:53,557 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 6410f9dd59224d6fbfb92d65326e165d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237747266 2023-03-19 14:55:53,558 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting f3666f1d62be4891bbcf342993725a9a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237748480 2023-03-19 14:55:53,558 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 17303dcef81143418b29569f623518b5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:53,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/54dcdbe2f0794b8f94b2247955d428a2, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/659b241e9653493dbfef58e5a949e8d8, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/1e15d32a6dea414aa10fcb25ea283236, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/03cbe734c1144e3d806946b2ad2a0068, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/120409ffa6bb400bb39b0bef90e5b695] to archive 2023-03-19 14:55:53,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:53,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/54dcdbe2f0794b8f94b2247955d428a2 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/54dcdbe2f0794b8f94b2247955d428a2 2023-03-19 14:55:53,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/659b241e9653493dbfef58e5a949e8d8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/659b241e9653493dbfef58e5a949e8d8 2023-03-19 14:55:53,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/1e15d32a6dea414aa10fcb25ea283236 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/1e15d32a6dea414aa10fcb25ea283236 2023-03-19 14:55:53,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/03cbe734c1144e3d806946b2ad2a0068 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/03cbe734c1144e3d806946b2ad2a0068 2023-03-19 14:55:53,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/120409ffa6bb400bb39b0bef90e5b695 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/120409ffa6bb400bb39b0bef90e5b695 2023-03-19 14:55:53,602 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): 1e58f793d571966c44e8ebe3a3e21750#family2#compaction#201 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:53,641 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230319e69af9eacf6f42e5abd79acd152617bb_del 2023-03-19 14:55:53,641 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319e69af9eacf6f42e5abd79acd152617bb_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230319e69af9eacf6f42e5abd79acd152617bb_del 2023-03-19 14:55:54,457 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac82fdb21ca04ac4b8743521b80b0910 2023-03-19 14:55:54,458 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/.tmp/family2/ac82fdb21ca04ac4b8743521b80b0910 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/ac82fdb21ca04ac4b8743521b80b0910 2023-03-19 14:55:54,461 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac82fdb21ca04ac4b8743521b80b0910 2023-03-19 14:55:54,461 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1e58f793d571966c44e8ebe3a3e21750/family2 of 1e58f793d571966c44e8ebe3a3e21750 into ac82fdb21ca04ac4b8743521b80b0910(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:54,461 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:54,462 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:54,462 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): 2c6c932d1f65851da008e24e8b5d8421/family1 is initiating major compaction (all files) 2023-03-19 14:55:54,462 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:54,462 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:54,463 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of 2c6c932d1f65851da008e24e8b5d8421/family1 in testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:54,463 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/a4ea04b376f14f11b33bd4d36ef7d77c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/b1b2027f758443949e5a353a83b9ce44, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/79b1d798b0da4587ba4b074b2c305aa7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/086b15b462be467ebda7402d5ec7b8f5, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/3807c134e3ee4e4491d665b08b4bedec] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp, totalSize=27.1 K 2023-03-19 14:55:54,463 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting a4ea04b376f14f11b33bd4d36ef7d77c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237744202 2023-03-19 14:55:54,463 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting b1b2027f758443949e5a353a83b9ce44, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237746137 2023-03-19 14:55:54,464 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 79b1d798b0da4587ba4b074b2c305aa7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237747265 2023-03-19 14:55:54,464 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 086b15b462be467ebda7402d5ec7b8f5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237748479 2023-03-19 14:55:54,464 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 3807c134e3ee4e4491d665b08b4bedec, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:54,470 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): 2c6c932d1f65851da008e24e8b5d8421#family1#compaction#202 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:54,500 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:55:54,500 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51d54719 to 127.0.0.1:56323 2023-03-19 14:55:54,500 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:55:54,542 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303190adcfd8d83314336b24d012d8956a2c1_del 2023-03-19 14:55:54,542 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303190adcfd8d83314336b24d012d8956a2c1_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303190adcfd8d83314336b24d012d8956a2c1_del 2023-03-19 14:55:54,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/044a7f82fa3e401582aa5bcce282d83a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/d25a9d99c7fe4c329896b97574a64f13, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/6410f9dd59224d6fbfb92d65326e165d, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/f3666f1d62be4891bbcf342993725a9a, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/17303dcef81143418b29569f623518b5] to archive 2023-03-19 14:55:54,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:54,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/044a7f82fa3e401582aa5bcce282d83a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/044a7f82fa3e401582aa5bcce282d83a 2023-03-19 14:55:54,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/d25a9d99c7fe4c329896b97574a64f13 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/d25a9d99c7fe4c329896b97574a64f13 2023-03-19 14:55:54,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/6410f9dd59224d6fbfb92d65326e165d to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/6410f9dd59224d6fbfb92d65326e165d 2023-03-19 14:55:54,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/f3666f1d62be4891bbcf342993725a9a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/f3666f1d62be4891bbcf342993725a9a 2023-03-19 14:55:54,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/17303dcef81143418b29569f623518b5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family2/17303dcef81143418b29569f623518b5 2023-03-19 14:55:54,998 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88c385f72a634e99a59a9adc6c32eb63 2023-03-19 14:55:54,999 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family1/88c385f72a634e99a59a9adc6c32eb63 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/88c385f72a634e99a59a9adc6c32eb63 2023-03-19 14:55:55,021 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88c385f72a634e99a59a9adc6c32eb63 2023-03-19 14:55:55,022 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2c6c932d1f65851da008e24e8b5d8421/family1 of 2c6c932d1f65851da008e24e8b5d8421 into 88c385f72a634e99a59a9adc6c32eb63(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:55,022 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:55,022 DEBUG [Listener at localhost.localdomain/46521] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-19 14:55:55,023 DEBUG [Listener at localhost.localdomain/46521] regionserver.HStore(1912): 2c6c932d1f65851da008e24e8b5d8421/family2 is initiating major compaction (all files) 2023-03-19 14:55:55,023 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-19 14:55:55,023 INFO [Listener at localhost.localdomain/46521] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-19 14:55:55,023 INFO [Listener at localhost.localdomain/46521] regionserver.HRegion(2259): Starting compaction of 2c6c932d1f65851da008e24e8b5d8421/family2 in testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:55,023 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/862f8eb1caea407eb858aa61f8e9a2e4, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/ed11d64d630c40979a66d7ba88bfdca9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/7acf85be425743ba9bc1875c54e00d31, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/b90041b9d7cc412e815da26ffd31c4cc, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/c2ef65b364c84ac9aeb0f5887e0ab81c] into tmpdir=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp, totalSize=25.4 K 2023-03-19 14:55:55,024 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 862f8eb1caea407eb858aa61f8e9a2e4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1679237744202 2023-03-19 14:55:55,024 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting ed11d64d630c40979a66d7ba88bfdca9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1679237746137 2023-03-19 14:55:55,024 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting 7acf85be425743ba9bc1875c54e00d31, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1679237747265 2023-03-19 14:55:55,025 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting b90041b9d7cc412e815da26ffd31c4cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1679237748479 2023-03-19 14:55:55,025 DEBUG [Listener at localhost.localdomain/46521] compactions.Compactor(207): Compacting c2ef65b364c84ac9aeb0f5887e0ab81c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-19 14:55:55,033 INFO [Listener at localhost.localdomain/46521] throttle.PressureAwareThroughputController(145): 2c6c932d1f65851da008e24e8b5d8421#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-19 14:55:55,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/a4ea04b376f14f11b33bd4d36ef7d77c, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/b1b2027f758443949e5a353a83b9ce44, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/79b1d798b0da4587ba4b074b2c305aa7, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/086b15b462be467ebda7402d5ec7b8f5, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/3807c134e3ee4e4491d665b08b4bedec] to archive 2023-03-19 14:55:55,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:55,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/a4ea04b376f14f11b33bd4d36ef7d77c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/a4ea04b376f14f11b33bd4d36ef7d77c 2023-03-19 14:55:55,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/b1b2027f758443949e5a353a83b9ce44 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/b1b2027f758443949e5a353a83b9ce44 2023-03-19 14:55:55,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/79b1d798b0da4587ba4b074b2c305aa7 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/79b1d798b0da4587ba4b074b2c305aa7 2023-03-19 14:55:55,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/086b15b462be467ebda7402d5ec7b8f5 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/086b15b462be467ebda7402d5ec7b8f5 2023-03-19 14:55:55,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/3807c134e3ee4e4491d665b08b4bedec to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/3807c134e3ee4e4491d665b08b4bedec 2023-03-19 14:55:55,442 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230319dfbb25ab40954475bf73602a02623f50_del 2023-03-19 14:55:55,443 INFO [Listener at localhost.localdomain/46521] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230319dfbb25ab40954475bf73602a02623f50_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230319dfbb25ab40954475bf73602a02623f50_del 2023-03-19 14:55:55,857 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0718968674b149ec8cb86f30bfa02e1c 2023-03-19 14:55:55,857 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/.tmp/family2/0718968674b149ec8cb86f30bfa02e1c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/0718968674b149ec8cb86f30bfa02e1c 2023-03-19 14:55:55,861 INFO [Listener at localhost.localdomain/46521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0718968674b149ec8cb86f30bfa02e1c 2023-03-19 14:55:55,862 INFO [Listener at localhost.localdomain/46521] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2c6c932d1f65851da008e24e8b5d8421/family2 of 2c6c932d1f65851da008e24e8b5d8421 into 0718968674b149ec8cb86f30bfa02e1c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-19 14:55:55,862 DEBUG [Listener at localhost.localdomain/46521] regionserver.HRegion(2289): Compaction status journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:55,865 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:55,868 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:55,871 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:55,873 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:55,876 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35187] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10vt\x1EC\x9E!}c\x96\xC1\xC5\x99kd\x1D\xC2"\x10K\x06p\xD6\xD7\x8C1'tO\xE9\xDE\x90_}\xC8*\x10V\x09\x064_\xE6\xDD\x14\xD5\xD4\xCE\x8C\x00\x07\xF7\xE52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-19 14:55:55,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-19 14:55:55,902 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-19 14:55:55,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:55:55,903 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1679238355903 2023-03-19 14:55:55,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-19 14:55:55,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/862f8eb1caea407eb858aa61f8e9a2e4, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/ed11d64d630c40979a66d7ba88bfdca9, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/7acf85be425743ba9bc1875c54e00d31, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/b90041b9d7cc412e815da26ffd31c4cc, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/c2ef65b364c84ac9aeb0f5887e0ab81c] to archive 2023-03-19 14:55:55,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:55,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/862f8eb1caea407eb858aa61f8e9a2e4 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/862f8eb1caea407eb858aa61f8e9a2e4 2023-03-19 14:55:55,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/ed11d64d630c40979a66d7ba88bfdca9 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/ed11d64d630c40979a66d7ba88bfdca9 2023-03-19 14:55:55,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/7acf85be425743ba9bc1875c54e00d31 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/7acf85be425743ba9bc1875c54e00d31 2023-03-19 14:55:55,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/b90041b9d7cc412e815da26ffd31c4cc to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/b90041b9d7cc412e815da26ffd31c4cc 2023-03-19 14:55:55,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/c2ef65b364c84ac9aeb0f5887e0ab81c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family2/c2ef65b364c84ac9aeb0f5887e0ab81c 2023-03-19 14:55:56,276 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-19 14:55:56,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303190adcfd8d83314336b24d012d8956a2c1_del 2023-03-19 14:55:56,325 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230319711163452e914809980aa6a0396cc1e2_del 2023-03-19 14:55:56,346 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230319a01abac3ec99496096d91cde833be6be_del 2023-03-19 14:55:56,346 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-19 14:55:56,347 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] zookeeper.ReadOnlyZKClient(139): Connect 0x0c071cb2 to 127.0.0.1:56323 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-19 14:55:56,351 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@742d10d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-19 14:55:56,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230319 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-19 14:55:56,922 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230319ab14c9b47db34efaa836d520c3fd7d17 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319ab14c9b47db34efaa836d520c3fd7d17 2023-03-19 14:55:56,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230319 table='testMajorCompactionFromAdmin' column='family1' 2023-03-19 14:55:56,938 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-19 14:55:56,940 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48916, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-19 14:55:56,950 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-19 14:55:56,951 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37028, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-19 14:55:56,989 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230319/family1/d2916e02a1804960a23c256e4ca50cc3 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-19 14:55:56,990 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230319/family1/d2916e02a1804960a23c256e4ca50cc3}] 2023-03-19 14:55:56,994 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230319/family1/d2916e02a1804960a23c256e4ca50cc3 for inclusion in 1e58f793d571966c44e8ebe3a3e21750/family1 2023-03-19 14:55:57,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-19 14:55:57,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-19 14:55:57,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:57,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230319/family1/d2916e02a1804960a23c256e4ca50cc3 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__8i3kbkdqgb5ig11jttmajr83dqdil1gahe90rjs0r2so78p64lfj7v3ibo62j4mt/family1/d2916e02a1804960a23c256e4ca50cc3 2023-03-19 14:55:57,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__8i3kbkdqgb5ig11jttmajr83dqdil1gahe90rjs0r2so78p64lfj7v3ibo62j4mt/family1/d2916e02a1804960a23c256e4ca50cc3 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/68d05b02334e4817baff6b02d14b4aa8_SeqId_28_ 2023-03-19 14:55:57,023 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__8i3kbkdqgb5ig11jttmajr83dqdil1gahe90rjs0r2so78p64lfj7v3ibo62j4mt/family1/d2916e02a1804960a23c256e4ca50cc3 into 1e58f793d571966c44e8ebe3a3e21750/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/68d05b02334e4817baff6b02d14b4aa8_SeqId_28_ - updating store file list. 2023-03-19 14:55:57,044 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/68d05b02334e4817baff6b02d14b4aa8_SeqId_28_ into 1e58f793d571966c44e8ebe3a3e21750/family1 2023-03-19 14:55:57,044 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__8i3kbkdqgb5ig11jttmajr83dqdil1gahe90rjs0r2so78p64lfj7v3ibo62j4mt/family1/d2916e02a1804960a23c256e4ca50cc3 into 1e58f793d571966c44e8ebe3a3e21750/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/family1/68d05b02334e4817baff6b02d14b4aa8_SeqId_28_) 2023-03-19 14:55:57,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__8i3kbkdqgb5ig11jttmajr83dqdil1gahe90rjs0r2so78p64lfj7v3ibo62j4mt/family1/d2916e02a1804960a23c256e4ca50cc3 2023-03-19 14:55:57,051 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230319 table='testMajorCompactionFromAdmin' column='family1' 2023-03-19 14:55:57,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:57,054 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031967d2fd61a9a4474eb5e0ded1c581d839 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031967d2fd61a9a4474eb5e0ded1c581d839 2023-03-19 14:55:57,055 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319778602f300a347c3986a4db3faf74f07 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319778602f300a347c3986a4db3faf74f07 2023-03-19 14:55:57,057 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303198bd51f5b1aeb4555b2f67a41452c980a to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303198bd51f5b1aeb4555b2f67a41452c980a 2023-03-19 14:55:57,059 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319cdc190b0542f4703867af6dd1a8658bc to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319cdc190b0542f4703867af6dd1a8658bc 2023-03-19 14:55:57,059 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-19 14:55:57,059 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230319' 2023-03-19 14:55:57,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230319 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-19 14:55:57,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230319 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-19 14:55:58,077 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303195cce34a2468a4fef9bd416cd9bccc672 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303195cce34a2468a4fef9bd416cd9bccc672 2023-03-19 14:55:58,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230319 table='testMajorCompactionFromAdmin' column='family1' 2023-03-19 14:55:58,117 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230319/family1/9f5bc32b22584aebb88bececab601d3b first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-19 14:55:58,118 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230319/family1/9f5bc32b22584aebb88bececab601d3b}] 2023-03-19 14:55:58,120 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230319/family1/9f5bc32b22584aebb88bececab601d3b for inclusion in 2c6c932d1f65851da008e24e8b5d8421/family1 2023-03-19 14:55:58,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-19 14:55:58,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(777): Region bounds: first= last=1 2023-03-19 14:55:58,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:58,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230319/family1/9f5bc32b22584aebb88bececab601d3b to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__ijaeipj8j5b2h3hrjocuef8dapu00h1vcbghpiq8gkr43jgsieo4oei2sqs3da2m/family1/9f5bc32b22584aebb88bececab601d3b 2023-03-19 14:55:58,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__ijaeipj8j5b2h3hrjocuef8dapu00h1vcbghpiq8gkr43jgsieo4oei2sqs3da2m/family1/9f5bc32b22584aebb88bececab601d3b as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/175a3bfa5d5b4529948b777dd0abb3bc_SeqId_28_ 2023-03-19 14:55:58,150 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__ijaeipj8j5b2h3hrjocuef8dapu00h1vcbghpiq8gkr43jgsieo4oei2sqs3da2m/family1/9f5bc32b22584aebb88bececab601d3b into 2c6c932d1f65851da008e24e8b5d8421/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/175a3bfa5d5b4529948b777dd0abb3bc_SeqId_28_ - updating store file list. 2023-03-19 14:55:58,169 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/175a3bfa5d5b4529948b777dd0abb3bc_SeqId_28_ into 2c6c932d1f65851da008e24e8b5d8421/family1 2023-03-19 14:55:58,169 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__ijaeipj8j5b2h3hrjocuef8dapu00h1vcbghpiq8gkr43jgsieo4oei2sqs3da2m/family1/9f5bc32b22584aebb88bececab601d3b into 2c6c932d1f65851da008e24e8b5d8421/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/family1/175a3bfa5d5b4529948b777dd0abb3bc_SeqId_28_) 2023-03-19 14:55:58,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__ijaeipj8j5b2h3hrjocuef8dapu00h1vcbghpiq8gkr43jgsieo4oei2sqs3da2m/family1/9f5bc32b22584aebb88bececab601d3b 2023-03-19 14:55:58,171 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230319 table='testMajorCompactionFromAdmin' column='family1' 2023-03-19 14:55:58,171 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:58,172 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303194b526092ed4f4b80b51427eebafb15b1 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303194b526092ed4f4b80b51427eebafb15b1 2023-03-19 14:55:58,173 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230319583c5ccbd01a44eb966ffeb6fabe32fd to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230319583c5ccbd01a44eb966ffeb6fabe32fd 2023-03-19 14:55:58,174 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023031981275cbc895e45798d72dfcec06ecc03 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023031981275cbc895e45798d72dfcec06ecc03 2023-03-19 14:55:58,174 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230319c53640cd882e4760b956e42158633be0 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230319c53640cd882e4760b956e42158633be0 2023-03-19 14:55:58,174 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-19 14:55:58,174 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230319' 2023-03-19 14:55:58,175 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230319 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-19 14:55:58,175 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230319 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-19 14:55:58,718 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303192bb594d989dd4e41bb3651adf850c205 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303192bb594d989dd4e41bb3651adf850c205 2023-03-19 14:55:58,719 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230319 table='testMajorCompactionFromAdmin' column='family1' 2023-03-19 14:55:58,758 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230319/family1/6f8536e894f0477db6c8413dd573435c first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-19 14:55:58,759 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74., hostname=jenkins-hbase20.apache.org,33191,1679237584457, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230319/family1/6f8536e894f0477db6c8413dd573435c}] 2023-03-19 14:55:58,761 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230319/family1/6f8536e894f0477db6c8413dd573435c for inclusion in 8109a875e9f73b5b519b5d4e5fb61c74/family1 2023-03-19 14:55:58,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-19 14:55:58,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-19 14:55:58,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegion(2446): Flush status journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:58,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230319/family1/6f8536e894f0477db6c8413dd573435c to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__eguig95pov2nl6snur08fndul92ulv5tjcv7t674fudu58rhlc1abvp99s7e1dq0/family1/6f8536e894f0477db6c8413dd573435c 2023-03-19 14:55:58,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__eguig95pov2nl6snur08fndul92ulv5tjcv7t674fudu58rhlc1abvp99s7e1dq0/family1/6f8536e894f0477db6c8413dd573435c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/01ec04f3958842b0865fba715f1428ad_SeqId_28_ 2023-03-19 14:55:58,781 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__eguig95pov2nl6snur08fndul92ulv5tjcv7t674fudu58rhlc1abvp99s7e1dq0/family1/6f8536e894f0477db6c8413dd573435c into 8109a875e9f73b5b519b5d4e5fb61c74/family1 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/01ec04f3958842b0865fba715f1428ad_SeqId_28_ - updating store file list. 2023-03-19 14:55:58,803 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/01ec04f3958842b0865fba715f1428ad_SeqId_28_ into 8109a875e9f73b5b519b5d4e5fb61c74/family1 2023-03-19 14:55:58,803 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__eguig95pov2nl6snur08fndul92ulv5tjcv7t674fudu58rhlc1abvp99s7e1dq0/family1/6f8536e894f0477db6c8413dd573435c into 8109a875e9f73b5b519b5d4e5fb61c74/family1 (new location: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/family1/01ec04f3958842b0865fba715f1428ad_SeqId_28_) 2023-03-19 14:55:58,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33191] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/staging/jenkins__testMajorCompactionFromAdmin__eguig95pov2nl6snur08fndul92ulv5tjcv7t674fudu58rhlc1abvp99s7e1dq0/family1/6f8536e894f0477db6c8413dd573435c 2023-03-19 14:55:58,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230319 table='testMajorCompactionFromAdmin' column='family1' 2023-03-19 14:55:58,805 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:58,807 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031924ab3cf22c1a427fa968dc4ad015b5c6 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031924ab3cf22c1a427fa968dc4ad015b5c6 2023-03-19 14:55:58,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031927b262ba18554867af9f39b398fee1e8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031927b262ba18554867af9f39b398fee1e8 2023-03-19 14:55:58,809 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031930eea9dfda7e4487a9f26147f5855fa8 to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023031930eea9dfda7e4487a9f26147f5855fa8 2023-03-19 14:55:58,810 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303197d69a38ac5f8465997fa02c3c0f96afa to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303197d69a38ac5f8465997fa02c3c0f96afa 2023-03-19 14:55:58,810 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-19 14:55:58,810 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230319' 2023-03-19 14:55:58,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230319 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-19 14:55:58,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-19 14:55:58,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-19 14:55:58,810 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303190adcfd8d83314336b24d012d8956a2c1_del] 2023-03-19 14:55:58,811 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:58,812 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303190adcfd8d83314336b24d012d8956a2c1_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303190adcfd8d83314336b24d012d8956a2c1_del 2023-03-19 14:55:58,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-19 14:55:58,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230319711163452e914809980aa6a0396cc1e2_del] 2023-03-19 14:55:58,812 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:58,813 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230319711163452e914809980aa6a0396cc1e2_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230319711163452e914809980aa6a0396cc1e2_del 2023-03-19 14:55:58,813 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-19 14:55:58,813 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319a01abac3ec99496096d91cde833be6be_del] 2023-03-19 14:55:58,813 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] backup.HFileArchiver(360): Archiving compacted files. 2023-03-19 14:55:58,814 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319a01abac3ec99496096d91cde833be6be_del to hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230319a01abac3ec99496096d91cde833be6be_del 2023-03-19 14:55:58,814 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-19 14:55:58,814 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1679237588347] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-19 14:55:58,815 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-19 14:55:58,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.9140 sec 2023-03-19 14:55:58,836 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:58,839 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:58,844 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-19 14:55:58,845 DEBUG [Listener at localhost.localdomain/46521] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-19 14:55:58,849 INFO [Listener at localhost.localdomain/46521] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-19 14:55:58,880 INFO [Listener at localhost.localdomain/46521] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 255), OpenFileDescriptor=648 (was 636) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=393 (was 249) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=4745 (was 5009) 2023-03-19 14:55:58,881 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cf395ba to 127.0.0.1:56323 2023-03-19 14:55:58,881 DEBUG [Listener at localhost.localdomain/46521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:55:58,881 INFO [Listener at localhost.localdomain/46521] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-19 14:55:58,881 INFO [Listener at localhost.localdomain/46521] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-19 14:55:58,881 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6acc7512 to 127.0.0.1:56323 2023-03-19 14:55:58,881 DEBUG [Listener at localhost.localdomain/46521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:55:58,881 DEBUG [Listener at localhost.localdomain/46521] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-19 14:55:58,881 DEBUG [Listener at localhost.localdomain/46521] util.JVMClusterUtil(257): Found active master hash=1273444862, stopped=false 2023-03-19 14:55:58,881 INFO [Listener at localhost.localdomain/46521] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,35187,1679237583319 2023-03-19 14:55:58,882 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-19 14:55:58,882 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-19 14:55:58,882 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-19 14:55:58,882 INFO [Listener at localhost.localdomain/46521] procedure2.ProcedureExecutor(629): Stopping 2023-03-19 14:55:58,882 DEBUG [Listener at localhost.localdomain/46521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33f34810 to 127.0.0.1:56323 2023-03-19 14:55:58,882 DEBUG [Listener at localhost.localdomain/46521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:55:58,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-19 14:55:58,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-19 14:55:58,882 INFO [Listener at localhost.localdomain/46521] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,33191,1679237584457' ***** 2023-03-19 14:55:58,883 INFO [Listener at localhost.localdomain/46521] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-19 14:55:58,883 INFO [RS:0;jenkins-hbase20:33191] regionserver.HeapMemoryManager(220): Stopping 2023-03-19 14:55:58,883 INFO [RS:0;jenkins-hbase20:33191] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-19 14:55:58,883 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-19 14:55:58,883 INFO [RS:0;jenkins-hbase20:33191] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-19 14:55:58,883 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 8109a875e9f73b5b519b5d4e5fb61c74 2023-03-19 14:55:58,883 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for adbe920c69673baa5c427cdf0bd93cc5 2023-03-19 14:55:58,883 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 1e58f793d571966c44e8ebe3a3e21750 2023-03-19 14:55:58,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8109a875e9f73b5b519b5d4e5fb61c74, disabling compactions & flushes 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 35f669f3cf30647988751ec77768992f 2023-03-19 14:55:58,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 62083c107c616f5c217d55e9a72a6e21 2023-03-19 14:55:58,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for e6a399820b946bc182d7646944c64598 2023-03-19 14:55:58,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. after waiting 0 ms 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 4b7e555dc6c9decb145e8efe79d877a7 2023-03-19 14:55:58,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 1197adada65eae2db55735ff4e977a96 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for c07026313222798b71dcd0ce84d17a24 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 87c27b1359899a7b93d3cb1ea602825a 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for affcc240214c2740e267f2d65797302f 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 9aa1fc0f1990ce625d14a4ce4d80764b 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 525b5eabd1937cfff55f6add30c5ff56 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for bdb5c439f8ed2752db29e637c75284e6 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 99ce07afa3cb560229849e2261b8f80f 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 388c287f67c220514160956691cb71c1 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 2c6c932d1f65851da008e24e8b5d8421 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for d7485b1a2967ecb08afbbe8485e3ef38 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 5777a952ba9f58d5e229708e1fb1584a 2023-03-19 14:55:58,884 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:55:58,884 DEBUG [RS:0;jenkins-hbase20:33191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34d84d19 to 127.0.0.1:56323 2023-03-19 14:55:58,884 DEBUG [RS:0;jenkins-hbase20:33191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:55:58,885 INFO [RS:0;jenkins-hbase20:33191] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-19 14:55:58,885 INFO [RS:0;jenkins-hbase20:33191] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-19 14:55:58,885 INFO [RS:0;jenkins-hbase20:33191] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-19 14:55:58,885 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-19 14:55:58,885 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-19 14:55:58,885 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-19 14:55:58,885 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-19 14:55:58,885 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-19 14:55:58,885 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-19 14:55:58,886 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-19 14:55:58,886 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-03-19 14:55:58,886 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1505): Waiting on 1197adada65eae2db55735ff4e977a96, 1588230740, 1e58f793d571966c44e8ebe3a3e21750, 2c6c932d1f65851da008e24e8b5d8421, 35f669f3cf30647988751ec77768992f, 388c287f67c220514160956691cb71c1, 4b7e555dc6c9decb145e8efe79d877a7, 525b5eabd1937cfff55f6add30c5ff56, 5777a952ba9f58d5e229708e1fb1584a, 62083c107c616f5c217d55e9a72a6e21, 8109a875e9f73b5b519b5d4e5fb61c74, 87c27b1359899a7b93d3cb1ea602825a, 99ce07afa3cb560229849e2261b8f80f, 9aa1fc0f1990ce625d14a4ce4d80764b, adbe920c69673baa5c427cdf0bd93cc5, affcc240214c2740e267f2d65797302f, bdb5c439f8ed2752db29e637c75284e6, c07026313222798b71dcd0ce84d17a24, d7485b1a2967ecb08afbbe8485e3ef38, e6a399820b946bc182d7646944c64598, f8e8d7cf2c5e169edcb3b943f53497bc 2023-03-19 14:55:58,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/8109a875e9f73b5b519b5d4e5fb61c74/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-19 14:55:58,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:58,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8109a875e9f73b5b519b5d4e5fb61c74: 2023-03-19 14:55:58,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1679237742015.8109a875e9f73b5b519b5d4e5fb61c74. 2023-03-19 14:55:58,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing adbe920c69673baa5c427cdf0bd93cc5, disabling compactions & flushes 2023-03-19 14:55:58,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:55:58,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:55:58,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. after waiting 0 ms 2023-03-19 14:55:58,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:55:58,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing adbe920c69673baa5c427cdf0bd93cc5 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-19 14:55:58,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5/.tmp/info/4136c408f47742b1a7a2e835bf41834c 2023-03-19 14:55:58,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5/.tmp/info/4136c408f47742b1a7a2e835bf41834c as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5/info/4136c408f47742b1a7a2e835bf41834c 2023-03-19 14:55:58,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5/info/4136c408f47742b1a7a2e835bf41834c, entries=3, sequenceid=7, filesize=4.8 K 2023-03-19 14:55:58,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for adbe920c69673baa5c427cdf0bd93cc5 in 16ms, sequenceid=7, compaction requested=false 2023-03-19 14:55:58,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/namespace/adbe920c69673baa5c427cdf0bd93cc5/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-19 14:55:58,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:55:58,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for adbe920c69673baa5c427cdf0bd93cc5: 2023-03-19 14:55:58,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1679237586902.adbe920c69673baa5c427cdf0bd93cc5. 2023-03-19 14:55:58,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1e58f793d571966c44e8ebe3a3e21750, disabling compactions & flushes 2023-03-19 14:55:58,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:58,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:58,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. after waiting 0 ms 2023-03-19 14:55:58,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:58,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/1e58f793d571966c44e8ebe3a3e21750/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-19 14:55:58,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:58,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1e58f793d571966c44e8ebe3a3e21750: 2023-03-19 14:55:58,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1679237742015.1e58f793d571966c44e8ebe3a3e21750. 2023-03-19 14:55:58,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 35f669f3cf30647988751ec77768992f, disabling compactions & flushes 2023-03-19 14:55:58,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:55:58,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:55:58,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. after waiting 0 ms 2023-03-19 14:55:58,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:55:58,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithMonthlyPolicy/35f669f3cf30647988751ec77768992f/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-19 14:55:58,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 35f669f3cf30647988751ec77768992f: 2023-03-19 14:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1679237601971.35f669f3cf30647988751ec77768992f. 2023-03-19 14:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 62083c107c616f5c217d55e9a72a6e21, disabling compactions & flushes 2023-03-19 14:55:58,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:55:58,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. after waiting 0 ms 2023-03-19 14:55:58,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:55:58,917 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-19 14:55:58,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/62083c107c616f5c217d55e9a72a6e21/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-03-19 14:55:58,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 62083c107c616f5c217d55e9a72a6e21: 2023-03-19 14:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1679237588534.62083c107c616f5c217d55e9a72a6e21. 2023-03-19 14:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e6a399820b946bc182d7646944c64598, disabling compactions & flushes 2023-03-19 14:55:58,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. after waiting 0 ms 2023-03-19 14:55:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:55:58,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/e6a399820b946bc182d7646944c64598/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-19 14:55:58,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:55:58,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e6a399820b946bc182d7646944c64598: 2023-03-19 14:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1679237626232.e6a399820b946bc182d7646944c64598. 2023-03-19 14:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4b7e555dc6c9decb145e8efe79d877a7, disabling compactions & flushes 2023-03-19 14:55:58,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. after waiting 0 ms 2023-03-19 14:55:58,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:55:58,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyPolicy/4b7e555dc6c9decb145e8efe79d877a7/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-19 14:55:58,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:55:58,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4b7e555dc6c9decb145e8efe79d877a7: 2023-03-19 14:55:58,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1679237630904.4b7e555dc6c9decb145e8efe79d877a7. 2023-03-19 14:55:58,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1197adada65eae2db55735ff4e977a96, disabling compactions & flushes 2023-03-19 14:55:58,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:58,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:58,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. after waiting 0 ms 2023-03-19 14:55:58,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:58,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithMonthlyPolicy/1197adada65eae2db55735ff4e977a96/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-19 14:55:58,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:58,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1197adada65eae2db55735ff4e977a96: 2023-03-19 14:55:58,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1679237730106.1197adada65eae2db55735ff4e977a96. 2023-03-19 14:55:58,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c07026313222798b71dcd0ce84d17a24, disabling compactions & flushes 2023-03-19 14:55:58,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:58,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:58,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. after waiting 0 ms 2023-03-19 14:55:58,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:58,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/c07026313222798b71dcd0ce84d17a24/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-19 14:55:58,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:58,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c07026313222798b71dcd0ce84d17a24: 2023-03-19 14:55:58,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1679237712955.c07026313222798b71dcd0ce84d17a24. 2023-03-19 14:55:58,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 87c27b1359899a7b93d3cb1ea602825a, disabling compactions & flushes 2023-03-19 14:55:58,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:58,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:58,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. after waiting 0 ms 2023-03-19 14:55:58,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:58,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/87c27b1359899a7b93d3cb1ea602825a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-19 14:55:58,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:58,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 87c27b1359899a7b93d3cb1ea602825a: 2023-03-19 14:55:58,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1679237712955.87c27b1359899a7b93d3cb1ea602825a. 2023-03-19 14:55:58,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing affcc240214c2740e267f2d65797302f, disabling compactions & flushes 2023-03-19 14:55:58,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:58,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:58,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. after waiting 0 ms 2023-03-19 14:55:58,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:58,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/affcc240214c2740e267f2d65797302f/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-19 14:55:58,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:58,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for affcc240214c2740e267f2d65797302f: 2023-03-19 14:55:58,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1679237684982.affcc240214c2740e267f2d65797302f. 2023-03-19 14:55:58,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9aa1fc0f1990ce625d14a4ce4d80764b, disabling compactions & flushes 2023-03-19 14:55:58,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:58,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:58,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. after waiting 0 ms 2023-03-19 14:55:58,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:58,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/9aa1fc0f1990ce625d14a4ce4d80764b/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-19 14:55:58,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:58,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9aa1fc0f1990ce625d14a4ce4d80764b: 2023-03-19 14:55:58,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1679237684982.9aa1fc0f1990ce625d14a4ce4d80764b. 2023-03-19 14:55:58,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 525b5eabd1937cfff55f6add30c5ff56, disabling compactions & flushes 2023-03-19 14:55:58,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:55:58,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:55:58,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. after waiting 0 ms 2023-03-19 14:55:58,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:55:58,956 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-19 14:55:58,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/525b5eabd1937cfff55f6add30c5ff56/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-19 14:55:58,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:55:58,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 525b5eabd1937cfff55f6add30c5ff56: 2023-03-19 14:55:58,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1679237661364.525b5eabd1937cfff55f6add30c5ff56. 2023-03-19 14:55:58,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f8e8d7cf2c5e169edcb3b943f53497bc, disabling compactions & flushes 2023-03-19 14:55:58,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:58,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:58,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. after waiting 0 ms 2023-03-19 14:55:58,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:58,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testCompactionWithHFileLink/f8e8d7cf2c5e169edcb3b943f53497bc/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-19 14:55:58,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:58,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f8e8d7cf2c5e169edcb3b943f53497bc: 2023-03-19 14:55:58,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1679237684982.f8e8d7cf2c5e169edcb3b943f53497bc. 2023-03-19 14:55:58,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bdb5c439f8ed2752db29e637c75284e6, disabling compactions & flushes 2023-03-19 14:55:58,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:58,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:58,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. after waiting 0 ms 2023-03-19 14:55:58,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:58,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/ns/testMinorCompaction/bdb5c439f8ed2752db29e637c75284e6/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-19 14:55:58,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:58,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bdb5c439f8ed2752db29e637c75284e6: 2023-03-19 14:55:58,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1679237712955.bdb5c439f8ed2752db29e637c75284e6. 2023-03-19 14:55:58,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 99ce07afa3cb560229849e2261b8f80f, disabling compactions & flushes 2023-03-19 14:55:58,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:55:58,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:55:58,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. after waiting 0 ms 2023-03-19 14:55:58,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:55:58,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/99ce07afa3cb560229849e2261b8f80f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-19 14:55:58,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:55:58,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 99ce07afa3cb560229849e2261b8f80f: 2023-03-19 14:55:58,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1679237626232.99ce07afa3cb560229849e2261b8f80f. 2023-03-19 14:55:58,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 388c287f67c220514160956691cb71c1, disabling compactions & flushes 2023-03-19 14:55:58,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:55:58,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:55:58,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. after waiting 0 ms 2023-03-19 14:55:58,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:55:58,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMinorCompactionWithWeeklyPolicy/388c287f67c220514160956691cb71c1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-19 14:55:58,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:55:58,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 388c287f67c220514160956691cb71c1: 2023-03-19 14:55:58,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1679237613854.388c287f67c220514160956691cb71c1. 2023-03-19 14:55:58,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2c6c932d1f65851da008e24e8b5d8421, disabling compactions & flushes 2023-03-19 14:55:58,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:58,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:58,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. after waiting 0 ms 2023-03-19 14:55:58,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:58,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionFromAdmin/2c6c932d1f65851da008e24e8b5d8421/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-19 14:55:58,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:58,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2c6c932d1f65851da008e24e8b5d8421: 2023-03-19 14:55:58,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1679237742015.2c6c932d1f65851da008e24e8b5d8421. 2023-03-19 14:55:58,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d7485b1a2967ecb08afbbe8485e3ef38, disabling compactions & flushes 2023-03-19 14:55:58,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:55:58,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:55:58,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. after waiting 0 ms 2023-03-19 14:55:58,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:55:58,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d7485b1a2967ecb08afbbe8485e3ef38/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-19 14:55:58,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:55:58,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d7485b1a2967ecb08afbbe8485e3ef38: 2023-03-19 14:55:58,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1679237644420.d7485b1a2967ecb08afbbe8485e3ef38. 2023-03-19 14:55:58,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5777a952ba9f58d5e229708e1fb1584a, disabling compactions & flushes 2023-03-19 14:55:58,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:55:58,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:55:58,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. after waiting 0 ms 2023-03-19 14:55:58,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:55:58,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/default/testScannerOnBulkLoadRefHFiles/5777a952ba9f58d5e229708e1fb1584a/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-19 14:55:58,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:55:58,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5777a952ba9f58d5e229708e1fb1584a: 2023-03-19 14:55:58,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1679237626232.5777a952ba9f58d5e229708e1fb1584a. 2023-03-19 14:55:59,086 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-19 14:55:59,287 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-19 14:55:59,297 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/.tmp/info/f78690719d704e248af95270b4dcf747 2023-03-19 14:55:59,308 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f78690719d704e248af95270b4dcf747 2023-03-19 14:55:59,487 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-19 14:55:59,688 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-19 14:55:59,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/.tmp/rep_barrier/8534926a56fa4305aed161361faaf9cd 2023-03-19 14:55:59,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8534926a56fa4305aed161361faaf9cd 2023-03-19 14:55:59,790 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-19 14:55:59,881 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-19 14:55:59,881 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-19 14:55:59,888 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-03-19 14:55:59,888 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-03-19 14:55:59,888 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-19 14:56:00,088 DEBUG [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-19 14:56:00,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/.tmp/table/bd9bbf620e13418db65d8de3395fc173 2023-03-19 14:56:00,138 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd9bbf620e13418db65d8de3395fc173 2023-03-19 14:56:00,139 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/.tmp/info/f78690719d704e248af95270b4dcf747 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/info/f78690719d704e248af95270b4dcf747 2023-03-19 14:56:00,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f78690719d704e248af95270b4dcf747 2023-03-19 14:56:00,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/info/f78690719d704e248af95270b4dcf747, entries=226, sequenceid=130, filesize=37.9 K 2023-03-19 14:56:00,145 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/.tmp/rep_barrier/8534926a56fa4305aed161361faaf9cd as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/rep_barrier/8534926a56fa4305aed161361faaf9cd 2023-03-19 14:56:00,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8534926a56fa4305aed161361faaf9cd 2023-03-19 14:56:00,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/rep_barrier/8534926a56fa4305aed161361faaf9cd, entries=1, sequenceid=130, filesize=5.0 K 2023-03-19 14:56:00,148 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/.tmp/table/bd9bbf620e13418db65d8de3395fc173 as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/table/bd9bbf620e13418db65d8de3395fc173 2023-03-19 14:56:00,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd9bbf620e13418db65d8de3395fc173 2023-03-19 14:56:00,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/table/bd9bbf620e13418db65d8de3395fc173, entries=27, sequenceid=130, filesize=6.6 K 2023-03-19 14:56:00,152 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1266ms, sequenceid=130, compaction requested=false 2023-03-19 14:56:00,156 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-19 14:56:00,156 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-19 14:56:00,156 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-19 14:56:00,156 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-19 14:56:00,156 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-19 14:56:00,289 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,33191,1679237584457; all regions closed. 2023-03-19 14:56:00,302 DEBUG [RS:0;jenkins-hbase20:33191] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/oldWALs 2023-03-19 14:56:00,302 INFO [RS:0;jenkins-hbase20:33191] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C33191%2C1679237584457.meta:.meta(num 1679237586606) 2023-03-19 14:56:00,309 DEBUG [RS:0;jenkins-hbase20:33191] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/oldWALs 2023-03-19 14:56:00,309 INFO [RS:0;jenkins-hbase20:33191] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C33191%2C1679237584457:(num 1679237586037) 2023-03-19 14:56:00,309 DEBUG [RS:0;jenkins-hbase20:33191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:56:00,309 INFO [RS:0;jenkins-hbase20:33191] regionserver.LeaseManager(133): Closed leases 2023-03-19 14:56:00,310 INFO [RS:0;jenkins-hbase20:33191] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-19 14:56:00,310 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-19 14:56:00,311 INFO [RS:0;jenkins-hbase20:33191] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:33191 2023-03-19 14:56:00,320 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,33191,1679237584457 2023-03-19 14:56:00,320 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-19 14:56:00,321 ERROR [Listener at localhost.localdomain/46521-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d0b5b75 rejected from java.util.concurrent.ThreadPoolExecutor@5934c40c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 530] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-19 14:56:00,321 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-19 14:56:00,321 ERROR [Listener at localhost.localdomain/46521-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ab7bafb rejected from java.util.concurrent.ThreadPoolExecutor@5934c40c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 530] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-19 14:56:00,321 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,33191,1679237584457] 2023-03-19 14:56:00,322 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,33191,1679237584457; numProcessing=1 2023-03-19 14:56:00,322 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,33191,1679237584457 already deleted, retry=false 2023-03-19 14:56:00,322 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,33191,1679237584457 expired; onlineServers=0 2023-03-19 14:56:00,322 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,35187,1679237583319' ***** 2023-03-19 14:56:00,322 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-19 14:56:00,323 DEBUG [M:0;jenkins-hbase20:35187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ada33c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-03-19 14:56:00,323 INFO [M:0;jenkins-hbase20:35187] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,35187,1679237583319 2023-03-19 14:56:00,323 INFO [M:0;jenkins-hbase20:35187] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,35187,1679237583319; all regions closed. 2023-03-19 14:56:00,323 DEBUG [M:0;jenkins-hbase20:35187] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-19 14:56:00,323 DEBUG [M:0;jenkins-hbase20:35187] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-19 14:56:00,324 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-19 14:56:00,324 DEBUG [M:0;jenkins-hbase20:35187] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-19 14:56:00,324 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1679237585751] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1679237585751,5,FailOnTimeoutGroup] 2023-03-19 14:56:00,324 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1679237585752] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1679237585752,5,FailOnTimeoutGroup] 2023-03-19 14:56:00,324 INFO [M:0;jenkins-hbase20:35187] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-19 14:56:00,324 INFO [M:0;jenkins-hbase20:35187] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-19 14:56:00,324 INFO [M:0;jenkins-hbase20:35187] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-03-19 14:56:00,324 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-19 14:56:00,324 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-19 14:56:00,324 DEBUG [M:0;jenkins-hbase20:35187] master.HMaster(1512): Stopping service threads 2023-03-19 14:56:00,325 INFO [M:0;jenkins-hbase20:35187] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-19 14:56:00,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-19 14:56:00,325 ERROR [M:0;jenkins-hbase20:35187] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-19 14:56:00,325 INFO [M:0;jenkins-hbase20:35187] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-19 14:56:00,325 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-19 14:56:00,326 DEBUG [M:0;jenkins-hbase20:35187] zookeeper.ZKUtil(398): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-19 14:56:00,326 WARN [M:0;jenkins-hbase20:35187] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-19 14:56:00,326 INFO [M:0;jenkins-hbase20:35187] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-19 14:56:00,326 INFO [M:0;jenkins-hbase20:35187] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-19 14:56:00,326 DEBUG [M:0;jenkins-hbase20:35187] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-19 14:56:00,326 INFO [M:0;jenkins-hbase20:35187] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-19 14:56:00,326 DEBUG [M:0;jenkins-hbase20:35187] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-19 14:56:00,326 DEBUG [M:0;jenkins-hbase20:35187] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-19 14:56:00,326 DEBUG [M:0;jenkins-hbase20:35187] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-19 14:56:00,326 INFO [M:0;jenkins-hbase20:35187] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.04 KB heapSize=598.84 KB 2023-03-19 14:56:00,421 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-19 14:56:00,421 INFO [RS:0;jenkins-hbase20:33191] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,33191,1679237584457; zookeeper connection closed. 2023-03-19 14:56:00,421 ERROR [Listener at localhost.localdomain/46521-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@528b393f rejected from java.util.concurrent.ThreadPoolExecutor@5934c40c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 530] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-19 14:56:00,422 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): regionserver:33191-0x1002a1226880001, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-19 14:56:00,422 ERROR [Listener at localhost.localdomain/46521-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b6ea31b rejected from java.util.concurrent.ThreadPoolExecutor@5934c40c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 530] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-19 14:56:00,422 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@71fea723] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@71fea723 2023-03-19 14:56:00,422 INFO [Listener at localhost.localdomain/46521] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-19 14:56:00,734 INFO [M:0;jenkins-hbase20:35187] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.04 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2708ea54f4f4447a9670d62ac38880ea 2023-03-19 14:56:00,739 INFO [M:0;jenkins-hbase20:35187] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2708ea54f4f4447a9670d62ac38880ea 2023-03-19 14:56:00,739 DEBUG [M:0;jenkins-hbase20:35187] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2708ea54f4f4447a9670d62ac38880ea as hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2708ea54f4f4447a9670d62ac38880ea 2023-03-19 14:56:00,742 INFO [M:0;jenkins-hbase20:35187] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2708ea54f4f4447a9670d62ac38880ea 2023-03-19 14:56:00,742 INFO [M:0;jenkins-hbase20:35187] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38377/user/jenkins/test-data/74891f64-71ab-b526-c60d-30bd55a9df0f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2708ea54f4f4447a9670d62ac38880ea, entries=123, sequenceid=1005, filesize=33.3 K 2023-03-19 14:56:00,743 INFO [M:0;jenkins-hbase20:35187] regionserver.HRegion(2948): Finished flush of dataSize ~513.04 KB/525349, heapSize ~598.83 KB/613200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1005, compaction requested=false 2023-03-19 14:56:00,743 INFO [M:0;jenkins-hbase20:35187] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-19 14:56:00,744 DEBUG [M:0;jenkins-hbase20:35187] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-19 14:56:00,745 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-19 14:56:00,745 INFO [M:0;jenkins-hbase20:35187] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-19 14:56:00,746 INFO [M:0;jenkins-hbase20:35187] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35187 2023-03-19 14:56:00,747 DEBUG [M:0;jenkins-hbase20:35187] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,35187,1679237583319 already deleted, retry=false 2023-03-19 14:56:00,848 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-19 14:56:00,848 INFO [M:0;jenkins-hbase20:35187] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,35187,1679237583319; zookeeper connection closed. 2023-03-19 14:56:00,849 ERROR [Listener at localhost.localdomain/46521-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2eba8671 rejected from java.util.concurrent.ThreadPoolExecutor@1800a3be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-19 14:56:00,849 DEBUG [Listener at localhost.localdomain/46521-EventThread] zookeeper.ZKWatcher(600): master:35187-0x1002a1226880000, quorum=127.0.0.1:56323, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-19 14:56:00,849 ERROR [Listener at localhost.localdomain/46521-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@64f73f33 rejected from java.util.concurrent.ThreadPoolExecutor@1800a3be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-19 14:56:00,851 WARN [Listener at localhost.localdomain/46521] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-19 14:56:00,855 INFO [Listener at localhost.localdomain/46521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-19 14:56:00,969 WARN [BP-170373635-148.251.75.209-1679237579633 heartbeating to localhost.localdomain/127.0.0.1:38377] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-19 14:56:00,969 WARN [BP-170373635-148.251.75.209-1679237579633 heartbeating to localhost.localdomain/127.0.0.1:38377] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-170373635-148.251.75.209-1679237579633 (Datanode Uuid 9c893e8f-308d-4932-a68b-74c956cc7de0) service to localhost.localdomain/127.0.0.1:38377 2023-03-19 14:56:00,971 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/cluster_f5186ab3-a777-2045-9287-c86a253161ea/dfs/data/data1/current/BP-170373635-148.251.75.209-1679237579633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-19 14:56:00,971 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/be5731dc-08ed-0a30-22ac-da5715f6af24/cluster_f5186ab3-a777-2045-9287-c86a253161ea/dfs/data/data2/current/BP-170373635-148.251.75.209-1679237579633] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-19 14:56:00,995 INFO [Listener at localhost.localdomain/46521] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-03-19 14:56:01,126 INFO [Listener at localhost.localdomain/46521] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-19 14:56:01,210 INFO [Listener at localhost.localdomain/46521] hbase.HBaseTestingUtility(1293): Minicluster is down